Nov 06 19:27:46 devstack cinder-volume[75822]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 19:27:46 devstack cinder-volume[75822]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 19:27:46 devstack cinder-volume[75822]: we strongly recommend against using it for new projects. Nov 06 19:27:46 devstack cinder-volume[75822]: If you are already using Eventlet, we recommend migrating to a different Nov 06 19:27:46 devstack cinder-volume[75822]: framework. For more detail see Nov 06 19:27:46 devstack cinder-volume[75822]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 19:27:46 devstack cinder-volume[75822]: import eventlet # noqa Nov 06 19:27:49 devstack cinder-volume[75822]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 19:27:49 devstack cinder-volume[75822]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 19:27:49 devstack cinder-volume[75822]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 19:27:50 devstack cinder-volume[75822]: INFO dbcounter [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Registered counter for database cinder Nov 06 19:27:50 devstack cinder-volume[75822]: DEBUG oslo_db.sqlalchemy.engines [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:27:50 devstack cinder-volume[75822]: DEBUG dbcounter [-] [75822] Writer thread running {{(pid=75822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 19:27:50 devstack cinder-volume[75822]: INFO cinder.rpc [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 19:27:50 devstack cinder-volume[75822]: INFO cinder.rpc [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 19:27:50 devstack cinder-volume[75822]: DEBUG oslo_db.sqlalchemy.engines [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:27:50 devstack cinder-volume[75822]: INFO cinder.volume.manager [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Determined volume DB was empty at startup. Nov 06 19:27:50 devstack cinder-volume[75822]: DEBUG cinder.volume.manager [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75822) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 19:27:50 devstack cinder-volume[75822]: INFO cinder.volume.manager [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 19:27:50 devstack cinder-volume[75822]: WARNING stevedore.named [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 19:27:50 devstack cinder-volume[75822]: WARNING castellan.key_manager [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 19:27:50 devstack cinder-volume[75822]: WARNING cinder.keymgr.conf_key_mgr [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 19:27:50 devstack cinder-volume[75822]: DEBUG cinder.volume.drivers.lvm [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75822) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 19:27:50 devstack cinder-volume[75822]: DEBUG oslo_concurrency.processutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_concurrency.processutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=75822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_db.sqlalchemy.engines [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:27:51 devstack cinder-volume[75822]: INFO cinder.rpc [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 19:27:51 devstack cinder-volume[75822]: INFO cinder.rpc [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 19:27:51 devstack cinder-volume[75822]: WARNING stevedore.named [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 19:27:51 devstack cinder-volume[75822]: WARNING castellan.key_manager [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 19:27:51 devstack cinder-volume[75822]: INFO cinder.volume.manager [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_db.sqlalchemy.engines [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:27:51 devstack cinder-volume[75822]: INFO oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Starting 1 workers Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Started child 76015 {{(pid=75822) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Full set of CONF: {{(pid=75822) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] ******************************************************************************** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Configuration options gathered from: {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] ================================================================================ {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] allow_availability_zone_fallback = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] allow_compression_on_image_upload = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] allowed_direct_url_schemes = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] api_rate_limit = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] auth_strategy = keystone {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] az_cache_duration = 3600 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_availability_zone = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_host = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_stats_polling_interval = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backup_api_class = cinder.backup.api.API {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backup_name_template = backup-%s {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backup_use_same_host = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backup_use_temp_snapshot = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] chap_password = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] chap_username = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_internal_tenant_project_id = 93d59ef9e208453fb65227f04417d07b {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_internal_tenant_user_id = 55021b2720da476eaf1faaab4a866092 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cloned_volume_same_az = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cluster = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] compression_format = gzip {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] compute_api_class = cinder.compute.nova.API {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[76015]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] config_dir = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] config_source = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] control_exchange = openstack {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] debug = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] default_availability_zone = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] default_group_type = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] default_volume_type = lvmdriver-1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] disk_geometry = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] driver_client_cert = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] driver_client_cert_key = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] driver_data_namespace = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] driver_ssl_cert_path = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] driver_ssl_cert_verify = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] driver_use_ssl = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] enable_force_upload = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] enable_new_services = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] enable_unsupported_driver = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] enforce_multipath_for_image_xfer = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] filter_function = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_api_insecure = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_api_ssl_compression = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_ca_certificates_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_catalog_info = image:glance:publicURL {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_num_retries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance_request_timeout = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] goodness_function = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] graceful_shutdown_timeout = 5 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] group_api_class = cinder.group.api.API {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] host = devstack {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_compress_on_upload = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_conversion_address_space_limit = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_conversion_cpu_limit = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_conversion_disable = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_introspection_address_space_limit = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_introspection_cpu_limit = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_upload_use_cinder_backend = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_upload_use_internal_tenant = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_volume_cache_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_volume_cache_max_count = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] image_volume_cache_max_size_gb = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] init_host_max_objects_retrieval = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] instance_format = [instance: %(uuid)s] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] iscsi_target_flags = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] iscsi_write_cache = on {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] iser_helper = tgtadm {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] iser_ip_address = 192.168.122.102 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] iser_port = 3260 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_color = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_config_append = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_dir = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_options = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_rotate_interval = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_rotate_interval_type = days {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] log_rotation_type = none {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] max_age = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] max_logfile_count = 30 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] max_logfile_size_mb = 200 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] max_over_subscription_ratio = 20.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] message_reap_interval = 86400 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] message_ttl = 2592000 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] migration_create_volume_timeout_secs = 300 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] monkey_patch = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] monkey_patch_modules = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] my_ip = 192.168.122.102 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] no_snapshot_gb_quota = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] num_iser_scan_tries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] num_shell_tries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] num_volume_device_scan_tries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] nvmeof_conn_info_version = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] nvmet_ns_id = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] nvmet_port_id = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] osapi_max_limit = 1000 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] osapi_volume_ext_list = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] osapi_volume_listen_port = 8776 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] osapi_volume_use_ssl = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] osapi_volume_workers = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] per_volume_size_limit = -1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] periodic_fuzzy_delay = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] periodic_interval = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] public_endpoint = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] publish_errors = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] quota_backup_gigabytes = 1000 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] quota_backups = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] quota_gigabytes = 1000 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] quota_groups = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] quota_snapshots = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] quota_volumes = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] rate_limit_burst = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] rate_limit_except_level = CRITICAL {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] rate_limit_interval = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 19:27:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] reinit_driver_count = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] replication_device = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] report_discard_supported = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] report_interval = 120 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] reservation_clean_interval = 86400 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] reservation_expire = 86400 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] reserved_image_namespaces = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] reserved_percentage = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] rpc_response_timeout = 120 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] run_external_periodic_tasks = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] scst_target_driver = iscsi {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] scst_target_iqn_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_down_time = 720 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] shell_completion = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] snapshot_name_template = snapshot-%s {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] snapshot_same_host = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] split_loggers = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] state_path = /opt/stack/data/cinder {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] storage_availability_zone = nova {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] storage_protocol = iSCSI {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] syslog_log_facility = LOG_USER {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] target_helper = lioadm {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] target_ip_address = 192.168.122.102 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] target_port = 3260 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] target_protocol = iscsi {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] target_secondary_ip_addresses = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] trace_flags = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] transport_url = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] until_refresh = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] use_chap_auth = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] use_default_quota_class = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] use_journal = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] use_json = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] use_multipath_for_image_xfer = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] use_stderr = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] use_syslog = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] verify_glance_signatures = enabled {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_api_class = cinder.volume.api.API {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_backend_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_clear = zero {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_clear_ionice = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_clear_size = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_copy_bps_limit = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_dd_blocksize = 1M {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_name_template = volume-%s {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_service_inithost_offload = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volume_usage_audit_period = month {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] zoning_mode = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_concurrency.disable_process_locking = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.auth_section = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.auth_type = password {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.auth_version = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.cache = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.include_service_catalog = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.insecure = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.interface = public {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_password = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcache_username = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.region_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.service_type = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.backend = dogpile.cache.null {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.backend_argument = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.backend_expiration_time = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.config_prefix = cache.oslo {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.debug_cache_backend = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.enable_retry_client = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.enable_socket_keepalive = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.expiration_time = 600 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.hashclient_retry_attempts = 2 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.memcache_dead_retry = 300 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.memcache_pool_maxsize = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.memcache_sasl_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.password = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.proxies = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.redis_db = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.redis_server = localhost:6379 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.retry_attempts = 2 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.retry_delay = 0.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.socket_keepalive_count = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.socket_keepalive_idle = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.socket_keepalive_interval = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.socket_timeout = 1.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.tls_allowed_ciphers = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.tls_cafile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.tls_certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.tls_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.tls_keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cache.username = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] coordination.backend_url = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.asyncio_connection = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.asyncio_slave_connection = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.backend = sqlalchemy {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.connection = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.connection_debug = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.connection_parameters = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.connection_recycle_time = 3600 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.connection_trace = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.db_inc_retry_interval = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.db_max_retries = 20 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack sudo[76019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 19:27:51 devstack sudo[76019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.db_max_retry_interval = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.db_retry_interval = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.max_overflow = 50 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.max_pool_size = 5 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.max_retries = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.mysql_wsrep_sync_wait = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.pool_timeout = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.retry_interval = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.slave_connection = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.sqlite_synchronous = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.synchronous_reader = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] database.use_db_reconnect = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_tracing.insecure = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.connection_string = messaging:// {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.es_doc_type = notification {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.es_scroll_size = 10000 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.es_scroll_time = 2m {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.filter_error_trace = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.hmac_keys = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.sentinel_service_name = mymaster {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.socket_timeout = 0.1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.trace_requests = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler.trace_sqlalchemy = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler_jaeger.process_tags = {} {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler_jaeger.service_name_prefix = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] profiler_otlp.service_name_prefix = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.enforce_new_defaults = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.policy_default_rule = default {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.policy_file = policy.yaml {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] privsep_osbrick.group = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] privsep_osbrick.helper_command = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] privsep_osbrick.user = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_sys_admin.group = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_sys_admin.helper_command = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] cinder_sys_admin.user = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.auth_section = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.auth_type = password {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.cafile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.collect_timing = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.insecure = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.send_service_user_token = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.split_loggers = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.timeout = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.tls_ciphers = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] service_user.tls_min_version = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.auth_section = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.auth_type = password {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.collect_timing = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.insecure = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.region_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.split_loggers = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.timeout = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.tls_ciphers = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] glance.tls_min_version = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.backend_availability_zone = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.chap_password = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.chap_username = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.disk_geometry = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.driver_client_cert = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.driver_client_cert_key = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.driver_data_namespace = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.driver_use_ssl = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.extra_capabilities = {} {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.filter_function = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.goodness_function = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.iscsi_target_flags = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.iscsi_write_cache = on {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.iser_helper = tgtadm {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.iser_port = 3260 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.lvm_share_target = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.lvm_type = auto {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.num_shell_tries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.replication_device = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.report_discard_supported = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.reserved_percentage = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.target_helper = tgtadm {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.target_port = 3260 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.target_protocol = iscsi {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.trace_flags = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.unique_fqdn_network = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.use_chap_auth = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_backend_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_clear = zero {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_clear_ionice = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_clear_size = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_reports.file_event_handler = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_reports.log_dir = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.backend_host = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.chap_password = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.chap_username = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.disk_geometry = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.driver_client_cert = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.extra_capabilities = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.filter_function = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.goodness_function = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.iser_helper = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.iser_ip_address = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.iser_port = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.lvm_share_target = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.lvm_type = auto {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.num_shell_tries = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.replication_device = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.report_discard_supported = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.reserved_percentage = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.scst_target_driver = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.storage_protocol = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.target_helper = lioadm {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.target_ip_address = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.target_port = 3260 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.trace_flags = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.use_chap_auth = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_clear = zero {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_clear_size = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] lvmdriver-1.volumes_dir = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.ssl = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_notifications.driver = [] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_notifications.retry = -1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] key_manager.fixed_key = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.barbican_api_version = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.barbican_endpoint = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.barbican_endpoint_type = public {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.barbican_region_name = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.cafile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.collect_timing = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.insecure = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.number_of_retries = 60 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.retry_delay = 1 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.send_service_user_token = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.split_loggers = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.timeout = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.tls_ciphers = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.tls_min_version = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.verify_ssl = True {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican.verify_ssl_path = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.auth_section = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.auth_type = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.cafile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.certfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.collect_timing = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.insecure = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.keyfile = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.split_loggers = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.timeout = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.tls_ciphers = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] barbican_service_user.tls_min_version = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.approle_role_id = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.approle_secret_id = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.auth_method = approle {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.auth_path = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.kv_mountpoint = secret {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.kv_path = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.kv_version = 2 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.namespace = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.root_token_id = **** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.ssl_ca_crt_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.timeout = 60.0 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.token_file = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.token_role = None {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.use_ssl = False {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:27:51 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] ******************************************************************************** {{(pid=75822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 19:27:52 devstack sudo[76019]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:52 devstack sudo[76172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:52 devstack sudo[76172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:52 devstack sudo[76172]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.271s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:27:52 devstack cinder-volume[76015]: INFO cinder.brick.local_dev.lvm [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:52 devstack sudo[76253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:27:52 devstack sudo[76253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:52 devstack sudo[76253]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG cinder.brick.local_dev.lvm [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76015) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 19:27:52 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:52 devstack sudo[76337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:52 devstack sudo[76337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:53 devstack sudo[76337]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.550s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:53 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:53 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:53 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:53 devstack sudo[76631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 19:27:53 devstack sudo[76631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:53 devstack sudo[76631]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.261s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:53 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:53 devstack sudo[76634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:27:53 devstack sudo[76634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:54 devstack sudo[76634]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:54 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:54 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:54 devstack sudo[76719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:27:54 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:54 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:54 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:54 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:54 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:27:54 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:54 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:54 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:54 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:54 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:54 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:55 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:55 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:55 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:55 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:55 devstack cinder-volume[76015]: INFO cinder.volume.drivers.lvm [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:55 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:55 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:55 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:55 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:27:55 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:55 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:55 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:55 devstack sudo[76831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:27:55 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:56 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:56 devstack sudo[76834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:56 devstack sudo[76834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:56 devstack sudo[76834]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:56 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:27:56 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:56 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:56 devstack cinder-volume[76015]: INFO cinder.volume.driver [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG cinder.volume.driver [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76015) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG oslo_db.sqlalchemy.engines [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writer thread running {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG cinder.db.api [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Building query based on filter {{(pid=76015) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG cinder.image.image_utils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76015) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 19:27:56 devstack cinder-volume[76015]: INFO cinder.keymgr.migration [None req-30f1306d-3cbf-4f6d-b002-a89ef9e1f392 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 19:27:56 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:56 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:27:56 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:57 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:57 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:27:57 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:57 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:57 devstack sudo[76849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:57 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:57 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:57 devstack sudo[76852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:27:57 devstack sudo[76852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:57 devstack sudo[76852]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:57 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:27:57 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Driver initialization completed successfully. Nov 06 19:27:57 devstack cinder-volume[76015]: INFO cinder.manager [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Initiating service 2 cleanup Nov 06 19:27:58 devstack cinder-volume[76015]: INFO cinder.manager [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Service 2 cleanup completed. Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG cinder.service [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Creating RPC server for service cinder-volume {{(pid=76015) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG cinder.service [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76015) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 19:27:58 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:58 devstack sudo[76855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:27:58 devstack sudo[76855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:58 devstack sudo[76855]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:58 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:27:58 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:58 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:58 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:58 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:27:58 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:59 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:59 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:59 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:27:59 devstack sudo[76866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:27:59 devstack sudo[76866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:27:59 devstack sudo[76866]: pam_unix(sudo:session): session closed for user root Nov 06 19:27:59 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:27:59 devstack cinder-volume[76015]: INFO cinder.volume.manager [None req-064b84fc-5f45-438e-b042-803eca86b0f0 None None] Driver post RPC initialization completed successfully. Nov 06 19:28:01 devstack cinder-volume[75822]: DEBUG dbcounter [-] [75822] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:28:08 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager._thread_info {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:28:08 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread count: 6 {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:28:08 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread info: [<_MainThread(MainThread, started 124493312602240)>, , , , , ] {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:28:09 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=4 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:28:09 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:29:08 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:29:08 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 19:29:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:29:08 devstack sudo[79143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:29:08 devstack sudo[79143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:29:08 devstack sudo[79143]: pam_unix(sudo:session): session closed for user root Nov 06 19:29:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:29:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:29:08 devstack sudo[79147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:29:08 devstack sudo[79147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:29:08 devstack sudo[79147]: pam_unix(sudo:session): session closed for user root Nov 06 19:29:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:29:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:29:08 devstack sudo[79223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:29:08 devstack sudo[79223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:29:09 devstack sudo[79223]: pam_unix(sudo:session): session closed for user root Nov 06 19:29:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:29:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:29:09 devstack sudo[79327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:29:09 devstack sudo[79327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:29:09 devstack sudo[79327]: pam_unix(sudo:session): session closed for user root Nov 06 19:29:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:29:09 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:29:09 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager._thread_info {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:29:09 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread count: 6 {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:29:09 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread info: [<_MainThread(MainThread, started 124493312602240)>, , , , , ] {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:30:08 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:30:08 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 19:30:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:30:08 devstack sudo[82379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:30:08 devstack sudo[82379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:30:08 devstack sudo[82379]: pam_unix(sudo:session): session closed for user root Nov 06 19:30:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:30:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:30:08 devstack sudo[82383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:30:08 devstack sudo[82383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:30:08 devstack sudo[82383]: pam_unix(sudo:session): session closed for user root Nov 06 19:30:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:30:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:30:08 devstack sudo[82386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:30:08 devstack sudo[82386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:30:09 devstack sudo[82386]: pam_unix(sudo:session): session closed for user root Nov 06 19:30:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:30:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:30:09 devstack sudo[82393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:30:09 devstack sudo[82393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:30:09 devstack sudo[82393]: pam_unix(sudo:session): session closed for user root Nov 06 19:30:09 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=1 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:30:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:30:09 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:30:09 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:UPDATE=1 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:31:08 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:31:08 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 19:31:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:31:08 devstack sudo[84576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:31:08 devstack sudo[84576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:31:08 devstack sudo[84576]: pam_unix(sudo:session): session closed for user root Nov 06 19:31:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:31:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:31:08 devstack sudo[84583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:31:08 devstack sudo[84583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:31:08 devstack sudo[84583]: pam_unix(sudo:session): session closed for user root Nov 06 19:31:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:31:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:31:08 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:31:08 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:31:09 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Nov 06 19:31:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:31:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:31:09 devstack sudo[84605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:31:09 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:31:09 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root Nov 06 19:31:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:31:09 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:31:09 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager._thread_info {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:31:09 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread count: 6 {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:31:09 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread info: [<_MainThread(MainThread, started 124493312602240)>, , , , , ] {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:32:08 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:32:08 devstack cinder-volume[76015]: DEBUG cinder.volume.drivers.lvm [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Updating volume stats {{(pid=76015) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 19:32:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:08 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 19:32:08 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:08 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:08 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:32:08 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:08 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:08 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:08 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 19:32:08 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:09 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:09 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 19:32:09 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG dbcounter [-] [76015] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:32:09 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG oslo_concurrency.processutils [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76015) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG cinder.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Notifying Schedulers of capabilities ... {{(pid=76015) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG oslo_service.periodic_task [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] Running periodic task VolumeManager._thread_info {{(pid=76015) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread count: 6 {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:32:09 devstack cinder-volume[76015]: DEBUG cinder.volume.manager [None req-2a00b59c-5013-43ab-a0b1-6111d4af6b56 None None] thread info: [<_MainThread(MainThread, started 124493312602240)>, , , , , ] {{(pid=76015) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:32:13 devstack cinder-volume[75822]: INFO oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Caught SIGTERM, stopping children Nov 06 19:32:13 devstack cinder-volume[75822]: DEBUG oslo_concurrency.lockutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Acquiring lock "singleton_lock" {{(pid=75822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 19:32:13 devstack cinder-volume[75822]: DEBUG oslo_concurrency.lockutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Acquired lock "singleton_lock" {{(pid=75822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 19:32:13 devstack cinder-volume[75822]: DEBUG oslo_concurrency.lockutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Releasing lock "singleton_lock" {{(pid=75822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 19:32:13 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Stop services. {{(pid=75822) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 19:32:13 devstack cinder-volume[75822]: DEBUG oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Killing children. {{(pid=75822) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 19:32:13 devstack cinder-volume[75822]: INFO oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Waiting on 1 children to exit Nov 06 19:32:18 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Acquiring lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 19:32:18 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Acquired lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 19:32:18 devstack cinder-volume[76015]: DEBUG oslo_concurrency.lockutils [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Releasing lock "singleton_lock" {{(pid=76015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 19:32:18 devstack cinder-volume[76015]: WARNING amqp [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 19:32:18 devstack cinder-volume[76015]: WARNING amqp [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 19:32:18 devstack cinder-volume[75822]: INFO oslo_service.backend._eventlet.service [None req-8059e0ef-9254-400b-b9d0-69f0f259f933 None None] Child 76015 exited with status 0 Nov 06 19:32:18 devstack cinder-volume[86083]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 19:32:18 devstack cinder-volume[86083]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 19:32:18 devstack cinder-volume[86083]: we strongly recommend against using it for new projects. Nov 06 19:32:18 devstack cinder-volume[86083]: If you are already using Eventlet, we recommend migrating to a different Nov 06 19:32:18 devstack cinder-volume[86083]: framework. For more detail see Nov 06 19:32:18 devstack cinder-volume[86083]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 19:32:18 devstack cinder-volume[86083]: import eventlet # noqa Nov 06 19:32:20 devstack cinder-volume[86083]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 19:32:20 devstack cinder-volume[86083]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 19:32:20 devstack cinder-volume[86083]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 19:32:21 devstack cinder-volume[86083]: INFO dbcounter [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Registered counter for database cinder Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_db.sqlalchemy.engines [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG dbcounter [-] [86083] Writer thread running {{(pid=86083) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 19:32:21 devstack cinder-volume[86083]: INFO cinder.rpc [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 19:32:21 devstack cinder-volume[86083]: INFO cinder.rpc [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_db.sqlalchemy.engines [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:21 devstack cinder-volume[86083]: INFO cinder.volume.manager [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Determined volume DB was empty at startup. Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG cinder.volume.manager [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86083) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 19:32:21 devstack cinder-volume[86083]: INFO cinder.volume.manager [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 19:32:21 devstack cinder-volume[86083]: WARNING stevedore.named [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 19:32:21 devstack cinder-volume[86083]: WARNING castellan.key_manager [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 19:32:21 devstack cinder-volume[86083]: WARNING cinder.keymgr.conf_key_mgr [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 19:32:21 devstack cinder-volume[86083]: INFO cinder.volume.manager [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_db.sqlalchemy.engines [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86083) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:21 devstack cinder-volume[86083]: INFO oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Starting 1 workers Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Started child 86302 {{(pid=86083) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Full set of CONF: {{(pid=86083) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] ******************************************************************************** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Configuration options gathered from: {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] ================================================================================ {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] allow_availability_zone_fallback = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] allow_compression_on_image_upload = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86302]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] allowed_direct_url_schemes = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] api_rate_limit = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] auth_strategy = keystone {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_availability_zone = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_host = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_stats_polling_interval = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backup_api_class = cinder.backup.api.API {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backup_name_template = backup-%s {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backup_use_same_host = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backup_use_temp_snapshot = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] chap_password = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] chap_username = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_internal_tenant_project_id = 93d59ef9e208453fb65227f04417d07b {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_internal_tenant_user_id = 55021b2720da476eaf1faaab4a866092 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cluster = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] compression_format = gzip {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] compute_api_class = cinder.compute.nova.API {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] config_dir = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] config_source = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] control_exchange = openstack {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] debug = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] default_availability_zone = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] default_group_type = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] default_volume_type = QuobyteHD {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] disk_geometry = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] driver_client_cert = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] driver_client_cert_key = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] driver_data_namespace = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] driver_ssl_cert_path = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] driver_ssl_cert_verify = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] driver_use_ssl = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] enable_new_services = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] enable_unsupported_driver = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] enabled_backends = ['QuobyteHD'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] enforce_multipath_for_image_xfer = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] filter_function = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_api_insecure = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_api_ssl_compression = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_ca_certificates_file = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_catalog_info = image:glance:publicURL {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_num_retries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance_request_timeout = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] goodness_function = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] graceful_shutdown_timeout = 5 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] group_api_class = cinder.group.api.API {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] host = devstack {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_compress_on_upload = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_conversion_address_space_limit = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:21 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_conversion_cpu_limit = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_conversion_disable = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_introspection_address_space_limit = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_introspection_cpu_limit = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_upload_use_cinder_backend = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_upload_use_internal_tenant = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_volume_cache_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_volume_cache_max_count = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] image_volume_cache_max_size_gb = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] init_host_max_objects_retrieval = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] instance_format = [instance: %(uuid)s] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] iscsi_target_flags = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] iscsi_write_cache = on {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] iser_helper = tgtadm {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] iser_ip_address = 192.168.122.102 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] iser_port = 3260 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_color = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_config_append = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_dir = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_file = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_options = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_rotate_interval = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86302]: INFO cinder.volume.manager [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.remotefs [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86302) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_rotate_interval_type = days {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] log_rotation_type = none {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] max_age = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] max_logfile_count = 30 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] max_logfile_size_mb = 200 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] max_over_subscription_ratio = 20.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] message_reap_interval = 86400 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] message_ttl = 2592000 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] migration_create_volume_timeout_secs = 300 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] monkey_patch = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] monkey_patch_modules = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] my_ip = 192.168.122.102 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] no_snapshot_gb_quota = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] num_iser_scan_tries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] num_shell_tries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] num_volume_device_scan_tries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] nvmeof_conn_info_version = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] nvmet_ns_id = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] nvmet_port_id = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] osapi_max_limit = 1000 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] osapi_volume_ext_list = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] osapi_volume_listen_port = 8776 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] osapi_volume_use_ssl = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] osapi_volume_workers = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] per_volume_size_limit = -1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] periodic_fuzzy_delay = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] periodic_interval = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] public_endpoint = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] publish_errors = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] quota_backup_gigabytes = 1000 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] quota_backups = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] quota_gigabytes = 1000 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] quota_groups = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] quota_snapshots = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] quota_volumes = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] rate_limit_burst = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] rate_limit_except_level = CRITICAL {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] rate_limit_interval = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] reinit_driver_count = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] replication_device = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] report_discard_supported = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] report_interval = 120 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] reservation_clean_interval = 86400 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] reservation_expire = 86400 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] reserved_image_namespaces = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] reserved_percentage = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] rpc_response_timeout = 120 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] run_external_periodic_tasks = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] scst_target_driver = iscsi {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] scst_target_iqn_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_down_time = 720 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] shell_completion = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] snapshot_name_template = snapshot-%s {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] split_loggers = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] state_path = /opt/stack/data/cinder {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] storage_availability_zone = nova {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] storage_protocol = iSCSI {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] syslog_log_facility = LOG_USER {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] target_helper = lioadm {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] target_ip_address = 192.168.122.102 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] target_port = 3260 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] target_protocol = iscsi {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] target_secondary_ip_addresses = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] trace_flags = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] transport_url = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] until_refresh = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] use_chap_auth = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] use_default_quota_class = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] use_journal = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] use_json = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] use_multipath_for_image_xfer = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] use_stderr = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] use_syslog = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] verify_glance_signatures = enabled {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_api_class = cinder.volume.api.API {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_backend_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_clear = zero {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_clear_ionice = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_clear_size = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_copy_bps_limit = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_dd_blocksize = 1M {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_name_template = volume-%s {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_service_inithost_offload = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volume_usage_audit_period = month {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] zoning_mode = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_concurrency.disable_process_locking = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.auth_section = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.auth_type = password {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.auth_version = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.cache = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.include_service_catalog = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.insecure = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.interface = public {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_password = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86302) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 19:32:22 devstack cinder-volume[86302]: WARNING cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 19:32:22 devstack cinder-volume[86302]: WARNING cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcache_username = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.region_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.service_type = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.backend = dogpile.cache.null {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.backend_argument = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.backend_expiration_time = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.config_prefix = cache.oslo {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.debug_cache_backend = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.enable_retry_client = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.enable_socket_keepalive = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.expiration_time = 600 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.hashclient_retry_attempts = 2 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.memcache_dead_retry = 300 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.memcache_pool_maxsize = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.memcache_sasl_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.password = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.proxies = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.redis_db = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.redis_server = localhost:6379 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.retry_attempts = 2 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.retry_delay = 0.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.socket_keepalive_count = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.socket_keepalive_idle = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.socket_keepalive_interval = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.socket_timeout = 1.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.tls_allowed_ciphers = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.tls_cafile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.tls_certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.tls_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.tls_keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cache.username = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] coordination.backend_url = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.asyncio_connection = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.asyncio_slave_connection = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.backend = sqlalchemy {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.connection = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.connection_debug = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.connection_parameters = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.connection_recycle_time = 3600 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.connection_trace = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.db_inc_retry_interval = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.db_max_retries = 20 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.db_max_retry_interval = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.db_retry_interval = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.max_overflow = 50 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.max_pool_size = 5 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.max_retries = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.mysql_wsrep_sync_wait = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.pool_timeout = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.retry_interval = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.slave_connection = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.sqlite_synchronous = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.synchronous_reader = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] database.use_db_reconnect = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_tracing.insecure = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.connection_string = messaging:// {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.es_doc_type = notification {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.es_scroll_size = 10000 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.es_scroll_time = 2m {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.filter_error_trace = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.hmac_keys = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.sentinel_service_name = mymaster {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.socket_timeout = 0.1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.trace_requests = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler.trace_sqlalchemy = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler_jaeger.process_tags = {} {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler_jaeger.service_name_prefix = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] profiler_otlp.service_name_prefix = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.enforce_new_defaults = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.policy_default_rule = default {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.policy_file = policy.yaml {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] privsep_osbrick.group = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] privsep_osbrick.helper_command = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] privsep_osbrick.user = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_sys_admin.group = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_sys_admin.helper_command = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] cinder_sys_admin.user = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.auth_section = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.auth_type = password {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.cafile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.collect_timing = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.insecure = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.send_service_user_token = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.split_loggers = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.timeout = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.tls_ciphers = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] service_user.tls_min_version = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.auth_section = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.auth_type = password {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.collect_timing = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.insecure = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.region_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.split_loggers = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.timeout = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.tls_ciphers = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] glance.tls_min_version = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.backend_availability_zone = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.chap_password = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.chap_username = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.disk_geometry = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.driver_client_cert = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.driver_client_cert_key = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.driver_data_namespace = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.driver_use_ssl = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.extra_capabilities = {} {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.filter_function = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.goodness_function = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.iscsi_target_flags = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.iscsi_write_cache = on {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.iser_helper = tgtadm {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.iser_port = 3260 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_host = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_login = admin {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_mount_options = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_password = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_private_key = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_share_path = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.num_shell_tries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.quobyte_volume_url = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.replication_device = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.report_discard_supported = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.reserved_percentage = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.target_helper = tgtadm {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.target_port = 3260 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.target_protocol = iscsi {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.trace_flags = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.unique_fqdn_network = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.use_chap_auth = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_backend_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_clear = zero {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_clear_ionice = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack quobyte-client[86303]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_clear_size = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack quobyte-client[86303]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_reports.file_event_handler = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_reports.log_dir = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.backend_availability_zone = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.backend_host = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.chap_password = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.chap_username = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.chiscsi_conf = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.disk_geometry = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.driver_client_cert = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.driver_data_namespace = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.driver_use_ssl = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.extra_capabilities = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.filter_function = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.goodness_function = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.iser_helper = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.iser_ip_address = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.iser_port = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: INFO cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 ... Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.iser_target_prefix = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 -c /etc/quobyte/client-cinder.cfg {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_host = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_login = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_mount_options = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_password = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_private_key = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_share_path = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_ssh_port = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.num_shell_tries = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.nvmet_port_id = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.replication_device = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.report_discard_supported = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.reserved_percentage = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.scst_target_driver = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.storage_protocol = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.target_helper = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.target_ip_address = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.target_port = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.target_prefix = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.target_protocol = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.trace_flags = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.use_chap_auth = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_clear = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_clear_size = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] QuobyteHD.volumes_dir = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.ssl = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_notifications.driver = [] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_notifications.retry = -1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 -c /etc/quobyte/client-cinder.cfg Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] key_manager.fixed_key = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.barbican_api_version = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.barbican_endpoint = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.barbican_endpoint_type = public {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.barbican_region_name = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.cafile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.collect_timing = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.insecure = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.number_of_retries = 60 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.retry_delay = 1 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.send_service_user_token = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.split_loggers = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.timeout = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.tls_ciphers = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.tls_min_version = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.verify_ssl = True {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican.verify_ssl_path = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.auth_section = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.auth_type = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.cafile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.certfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.collect_timing = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.insecure = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.keyfile = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.split_loggers = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.timeout = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.tls_ciphers = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] barbican_service_user.tls_min_version = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.approle_role_id = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.approle_secret_id = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.auth_method = approle {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.auth_path = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.kv_mountpoint = secret {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.kv_path = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.kv_version = 2 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.namespace = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.root_token_id = **** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.ssl_ca_crt_file = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.timeout = 60.0 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.token_file = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.token_role = None {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.use_ssl = False {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:22 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] ******************************************************************************** {{(pid=86083) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 19:32:22 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.439s {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:22 devstack cinder-volume[86302]: INFO cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 succeeded Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.458s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:22 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:32:22 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:22 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.257s {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:22 devstack cinder-volume[86302]: INFO cinder.volume.driver [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 19:32:22 devstack cinder-volume[86302]: DEBUG cinder.volume.driver [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8011436462402, 'free_capacity_gb': 1773.8011436462402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86302) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_db.sqlalchemy.engines [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86302) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG dbcounter [-] [86302] Writer thread running {{(pid=86302) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.db.api [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Building query based on filter {{(pid=86302) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.image.image_utils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86302) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 19:32:23 devstack cinder-volume[86302]: INFO cinder.keymgr.migration [None req-8bc39213-8805-4f4b-98dd-636f33929d73 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:23 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:32:23 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:23 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.256s {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.manager [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Notifying Schedulers of capabilities ... {{(pid=86302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:32:23 devstack cinder-volume[86302]: INFO cinder.volume.manager [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Driver initialization completed successfully. Nov 06 19:32:23 devstack cinder-volume[86302]: INFO cinder.manager [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Initiating service 3 cleanup Nov 06 19:32:23 devstack cinder-volume[86302]: INFO cinder.manager [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Service 3 cleanup completed. Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.service [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Creating RPC server for service cinder-volume {{(pid=86302) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.service [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86302) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 19:32:23 devstack cinder-volume[86302]: INFO cinder.volume.manager [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:23 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:32:23 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:23 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:23 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.351s {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:23 devstack cinder-volume[86302]: INFO cinder.volume.manager [None req-b1bd4a9a-9dc3-43ad-80b6-775d542833e8 None None] Driver post RPC initialization completed successfully. Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86302) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG cinder.volume.drivers.quobyte [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86302) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86302) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:27 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:32:27 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:27 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG oslo_concurrency.processutils [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.234s {{(pid=86302) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:27 devstack cinder-volume[86302]: DEBUG cinder.manager [None req-438c71de-bac7-49a2-9ea5-15e0a7b7319e None None] Notifying Schedulers of capabilities ... {{(pid=86302) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:32:28 devstack cinder-volume[86083]: INFO oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Caught SIGTERM, stopping children Nov 06 19:32:28 devstack cinder-volume[86083]: DEBUG oslo_concurrency.lockutils [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Acquiring lock "singleton_lock" {{(pid=86083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 19:32:28 devstack cinder-volume[86083]: DEBUG oslo_concurrency.lockutils [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Acquired lock "singleton_lock" {{(pid=86083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 19:32:28 devstack cinder-volume[86083]: DEBUG oslo_concurrency.lockutils [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Releasing lock "singleton_lock" {{(pid=86083) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 19:32:28 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Stop services. {{(pid=86083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 19:32:28 devstack cinder-volume[86083]: DEBUG oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Killing children. {{(pid=86083) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 19:32:28 devstack cinder-volume[86083]: INFO oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Waiting on 1 children to exit Nov 06 19:32:31 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Acquiring lock "singleton_lock" {{(pid=86302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 19:32:31 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Acquired lock "singleton_lock" {{(pid=86302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 19:32:31 devstack cinder-volume[86302]: DEBUG oslo_concurrency.lockutils [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Releasing lock "singleton_lock" {{(pid=86302) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 19:32:31 devstack cinder-volume[86302]: WARNING amqp [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 19:32:31 devstack cinder-volume[86302]: WARNING amqp [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 19:32:31 devstack cinder-volume[86083]: INFO oslo_service.backend._eventlet.service [None req-5907575e-760d-4962-8317-34b9f8233b3b None None] Child 86302 exited with status 0 Nov 06 19:32:32 devstack cinder-volume[86623]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 19:32:32 devstack cinder-volume[86623]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 19:32:32 devstack cinder-volume[86623]: we strongly recommend against using it for new projects. Nov 06 19:32:32 devstack cinder-volume[86623]: If you are already using Eventlet, we recommend migrating to a different Nov 06 19:32:32 devstack cinder-volume[86623]: framework. For more detail see Nov 06 19:32:32 devstack cinder-volume[86623]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 19:32:32 devstack cinder-volume[86623]: import eventlet # noqa Nov 06 19:32:35 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 19:32:35 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 19:32:35 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 19:32:36 devstack cinder-volume[86623]: INFO dbcounter [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Registered counter for database cinder Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG dbcounter [-] [86623] Writer thread running {{(pid=86623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 19:32:36 devstack cinder-volume[86623]: INFO cinder.rpc [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 19:32:36 devstack cinder-volume[86623]: INFO cinder.rpc [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:36 devstack cinder-volume[86623]: INFO cinder.volume.manager [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Determined volume DB was empty at startup. Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG cinder.volume.manager [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86623) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 19:32:36 devstack cinder-volume[86623]: WARNING stevedore.named [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 19:32:36 devstack cinder-volume[86623]: WARNING castellan.key_manager [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 19:32:36 devstack cinder-volume[86623]: WARNING cinder.keymgr.conf_key_mgr [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 19:32:36 devstack cinder-volume[86623]: INFO cinder.volume.manager [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:36 devstack cinder-volume[86623]: INFO oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Starting 1 workers Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Started child 86928 {{(pid=86623) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Full set of CONF: {{(pid=86623) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] ******************************************************************************** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] Configuration options gathered from: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] ================================================================================ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] allow_availability_zone_fallback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] allow_compression_on_image_upload = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] allowed_direct_url_schemes = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] api_rate_limit = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] auth_strategy = keystone {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_host = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_stats_polling_interval = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backup_api_class = cinder.backup.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backup_name_template = backup-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backup_use_same_host = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backup_use_temp_snapshot = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] chap_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] chap_username = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_internal_tenant_project_id = 93d59ef9e208453fb65227f04417d07b {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_internal_tenant_user_id = 55021b2720da476eaf1faaab4a866092 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cluster = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] compression_format = gzip {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] compute_api_class = cinder.compute.nova.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86928]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] config_dir = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] config_source = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] control_exchange = openstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] debug = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] default_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] default_group_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] default_volume_type = QuobyteHD {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] disk_geometry = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] driver_client_cert = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] driver_ssl_cert_verify = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] driver_use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] enable_new_services = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] enable_unsupported_driver = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] enabled_backends = ['QuobyteHD'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] enforce_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] filter_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_api_insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_api_ssl_compression = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_ca_certificates_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_catalog_info = image:glance:publicURL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_num_retries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance_request_timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] goodness_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] graceful_shutdown_timeout = 5 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] group_api_class = cinder.group.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] host = devstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_compress_on_upload = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_conversion_address_space_limit = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_conversion_cpu_limit = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_conversion_disable = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_introspection_address_space_limit = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_introspection_cpu_limit = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_upload_use_cinder_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_upload_use_internal_tenant = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_volume_cache_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_volume_cache_max_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] image_volume_cache_max_size_gb = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] init_host_max_objects_retrieval = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] instance_format = [instance: %(uuid)s] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] iscsi_target_flags = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] iscsi_write_cache = on {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] iser_helper = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] iser_ip_address = 192.168.122.102 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] iser_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_color = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_config_append = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_dir = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_options = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_rotate_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_rotate_interval_type = days {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] log_rotation_type = none {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] max_age = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] max_logfile_count = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] max_logfile_size_mb = 200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] max_over_subscription_ratio = 20.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] message_reap_interval = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] message_ttl = 2592000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] migration_create_volume_timeout_secs = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] monkey_patch = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] monkey_patch_modules = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] my_ip = 192.168.122.102 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] no_snapshot_gb_quota = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] num_iser_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] num_shell_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] num_volume_device_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] nvmeof_conn_info_version = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] nvmet_ns_id = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] nvmet_port_id = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] osapi_max_limit = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] osapi_volume_ext_list = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] osapi_volume_listen_port = 8776 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] osapi_volume_use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] osapi_volume_workers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] per_volume_size_limit = -1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] periodic_fuzzy_delay = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] periodic_interval = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] public_endpoint = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] publish_errors = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] quota_backup_gigabytes = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] quota_backups = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] quota_gigabytes = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] quota_groups = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] quota_snapshots = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] quota_volumes = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] rate_limit_burst = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] rate_limit_except_level = CRITICAL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] rate_limit_interval = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] reinit_driver_count = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] replication_device = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] report_discard_supported = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] report_interval = 120 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] reservation_clean_interval = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] reservation_expire = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] reserved_image_namespaces = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] reserved_percentage = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] rpc_response_timeout = 120 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] run_external_periodic_tasks = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] scst_target_driver = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_down_time = 720 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] shell_completion = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] snapshot_name_template = snapshot-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] state_path = /opt/stack/data/cinder {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] storage_availability_zone = nova {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] storage_protocol = iSCSI {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] syslog_log_facility = LOG_USER {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] target_helper = lioadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] target_ip_address = 192.168.122.102 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] target_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] target_protocol = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] target_secondary_ip_addresses = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] trace_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] transport_url = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] until_refresh = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] use_chap_auth = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] use_default_quota_class = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-407b433f-2038-45b8-b666-fe956194f297 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86928) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] use_journal = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] use_json = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] use_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] use_stderr = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] use_syslog = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] verify_glance_signatures = enabled {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_api_class = cinder.volume.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_backend_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_clear = zero {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_clear_ionice = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_clear_size = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_copy_bps_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_dd_blocksize = 1M {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_name_template = volume-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_service_inithost_offload = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volume_usage_audit_period = month {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] zoning_mode = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_concurrency.disable_process_locking = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.auth_type = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.auth_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.cache = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.include_service_catalog = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.interface = public {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcache_username = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.region_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.service_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.backend = dogpile.cache.null {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.backend_argument = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.backend_expiration_time = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.config_prefix = cache.oslo {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.debug_cache_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.enable_retry_client = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.enable_socket_keepalive = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.expiration_time = 600 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.hashclient_retry_attempts = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.memcache_dead_retry = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.memcache_pool_maxsize = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.memcache_sasl_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.proxies = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.redis_db = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.redis_server = localhost:6379 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.retry_attempts = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.retry_delay = 0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.socket_keepalive_count = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.socket_keepalive_idle = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.socket_keepalive_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.socket_timeout = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.tls_allowed_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.tls_cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.tls_certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.tls_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.tls_keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cache.username = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] coordination.backend_url = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.asyncio_connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.asyncio_slave_connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.backend = sqlalchemy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.connection_debug = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.connection_parameters = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.connection_recycle_time = 3600 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.connection_trace = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.db_inc_retry_interval = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.db_max_retries = 20 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.db_max_retry_interval = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.db_retry_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.max_overflow = 50 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.max_pool_size = 5 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.max_retries = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.mysql_wsrep_sync_wait = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.pool_timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.retry_interval = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.slave_connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.sqlite_synchronous = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.synchronous_reader = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] database.use_db_reconnect = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_tracing.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.connection_string = messaging:// {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.es_doc_type = notification {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.es_scroll_size = 10000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.es_scroll_time = 2m {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.filter_error_trace = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.hmac_keys = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:36 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.sentinel_service_name = mymaster {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.socket_timeout = 0.1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.trace_requests = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler.trace_sqlalchemy = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler_jaeger.process_tags = {} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler_jaeger.service_name_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] profiler_otlp.service_name_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.enforce_new_defaults = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.policy_default_rule = default {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.policy_file = policy.yaml {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] privsep_osbrick.group = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] privsep_osbrick.helper_command = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] privsep_osbrick.user = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_sys_admin.group = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_sys_admin.helper_command = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] cinder_sys_admin.user = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.auth_type = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.send_service_user_token = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86928) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 19:32:37 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] service_user.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.auth_type = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.region_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] glance.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.chap_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.chap_username = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Running cmd (subprocess): mount.quobyte {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.disk_geometry = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.driver_client_cert = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.driver_use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.extra_capabilities = {} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.filter_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.goodness_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.iscsi_target_flags = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.iscsi_write_cache = on {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.iser_helper = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.iser_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_host = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_login = admin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_mount_options = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_private_key = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_share_path = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.num_shell_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.quobyte_volume_url = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.replication_device = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.report_discard_supported = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.reserved_percentage = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.target_helper = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.target_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.target_protocol = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.trace_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.unique_fqdn_network = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.use_chap_auth = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_backend_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_clear = zero {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_clear_ionice = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_clear_size = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_reports.file_event_handler = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_reports.log_dir = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.backend_host = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.chap_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.chap_username = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.chiscsi_conf = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.disk_geometry = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.driver_client_cert = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.driver_use_ssl = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.extra_capabilities = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.filter_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack quobyte-client[86929]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 19:32:37 devstack quobyte-client[86929]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.goodness_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.iser_helper = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.iser_ip_address = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.iser_port = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.iser_target_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_host = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_login = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_mount_options = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_private_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_share_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_ssh_port = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.num_shell_tries = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.nvmet_port_id = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.replication_device = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.report_discard_supported = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.reserved_percentage = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.scst_target_driver = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.storage_protocol = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.target_helper = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.target_ip_address = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.target_port = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.target_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.target_protocol = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.trace_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.use_chap_auth = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_clear = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_clear_size = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] QuobyteHD.volumes_dir = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_notifications.driver = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_notifications.retry = -1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] key_manager.fixed_key = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.barbican_api_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.barbican_endpoint = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.barbican_endpoint_type = public {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.barbican_region_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.number_of_retries = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.retry_delay = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.send_service_user_token = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.verify_ssl = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican.verify_ssl_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.auth_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] barbican_service_user.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.approle_role_id = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.approle_secret_id = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.auth_method = approle {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.auth_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.kv_mountpoint = secret {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.kv_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.kv_version = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.root_token_id = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.ssl_ca_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.timeout = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.token_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.token_role = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 19:32:37 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-9a1d9c51-6c10-4347-9c8d-2400e0736806 None None] ******************************************************************************** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 19:32:37 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:37 devstack cinder-volume[86928]: INFO cinder.volume.driver [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.driver [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8011436462402, 'free_capacity_gb': 1773.8011436462402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86928) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_db.sqlalchemy.engines [None req-407b433f-2038-45b8-b666-fe956194f297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writer thread running {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.db.api [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Building query based on filter {{(pid=86928) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86928) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:37 devstack cinder-volume[86928]: INFO cinder.keymgr.migration [None req-7e97839d-dcd4-42c0-ba37-ce5a7414dfd7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 19:32:37 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:32:37 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:37 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.233s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:32:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Driver initialization completed successfully. Nov 06 19:32:37 devstack cinder-volume[86928]: INFO cinder.manager [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Initiating service 3 cleanup Nov 06 19:32:37 devstack cinder-volume[86928]: INFO cinder.manager [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Service 3 cleanup completed. Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.service [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Creating RPC server for service cinder-volume {{(pid=86928) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.service [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86928) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 19:32:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:32:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:32:37 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:32:37 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:32:38 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Nov 06 19:32:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407b433f-2038-45b8-b666-fe956194f297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:32:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-407b433f-2038-45b8-b666-fe956194f297 None None] Driver post RPC initialization completed successfully. Nov 06 19:32:46 devstack cinder-volume[86623]: DEBUG dbcounter [-] [86623] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:32:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:32:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 6 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:32:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:32:47 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:32:48 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Flow 'volume_create_manager' (75ab2774-c554-4e7c-b3d4-0b1ae038e6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43678376-3d0b-4f74-999a-620f760dd24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43678376-3d0b-4f74-999a-620f760dd24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1751437918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121233cf-bfff-4849-9e45-3b832fb50f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4145d9a63c468e8345d5ab9813a39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:33:36Z,use_quota=True,user_id='9a8d38fca6c34dcd91b72f2418a5a0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779e0146-d63e-4594-9341-f18c75f3e731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779e0146-d63e-4594-9341-f18c75f3e731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4342096-bfa1-45a8-aed5-7178800738f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4342096-bfa1-45a8-aed5-7178800738f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '121233cf-bfff-4849-9e45-3b832fb50f63', 'volume_name': 'volume-121233cf-bfff-4849-9e45-3b832fb50f63', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6832a84-5408-4e29-a0f7-76bcc10d35b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6832a84-5408-4e29-a0f7-76bcc10d35b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936015d1-8fff-43cc-b19e-107369a84a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:36 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Volume 121233cf-bfff-4849-9e45-3b832fb50f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-121233cf-bfff-4849-9e45-3b832fb50f63', 'volume_size': 1} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1751437918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=121233cf-bfff-4849-9e45-3b832fb50f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4145d9a63c468e8345d5ab9813a39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:33:36Z,use_quota=True,user_id='9a8d38fca6c34dcd91b72f2418a5a0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Creating volume 121233cf-bfff-4849-9e45-3b832fb50f63 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:33:36 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:33:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:33:36 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 1073741824 Nov 06 19:33:36 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:33:37 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 1073741824" returned: 0 in 0.566s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:33:37 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 Nov 06 19:33:37 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:33:37 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63" returned: 0 in 0.280s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936015d1-8fff-43cc-b19e-107369a84a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-121233cf-bfff-4849-9e45-3b832fb50f63', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0062a3b6-06dc-4ac0-96ec-8c5501f071f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Volume volume-121233cf-bfff-4849-9e45-3b832fb50f63 (121233cf-bfff-4849-9e45-3b832fb50f63): created successfully Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0062a3b6-06dc-4ac0-96ec-8c5501f071f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Flow 'volume_create_manager' (75ab2774-c554-4e7c-b3d4-0b1ae038e6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:33:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ea6a88b0-d1c1-440d-9dd8-36140f098a83 tempest-TaggedAttachmentsTest-716802486 None] Created volume successfully. Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:33:47 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:33:47 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:33:47 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.785s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 6 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:33:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Flow 'volume_create_manager' (1448626e-ab6e-4495-9443-286e07de7e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6effcf7c-3303-42aa-8dc6-afd1293cf0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6effcf7c-3303-42aa-8dc6-afd1293cf0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1778228877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fe572c-5053-48b9-a29d-94783814c518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce73c38b9b646d58f64d0855f6b6da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:33:50Z,use_quota=True,user_id='2f63ba0c38264a25b5950f4f3daf72a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ad0bc4-33f6-409b-9107-b88732314cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ad0bc4-33f6-409b-9107-b88732314cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5dfa6-6ed3-43cd-b659-6e24b7cdf679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5dfa6-6ed3-43cd-b659-6e24b7cdf679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fe572c-5053-48b9-a29d-94783814c518', 'volume_name': 'volume-45fe572c-5053-48b9-a29d-94783814c518', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a716bb98-0a4b-4e47-bd60-a67f14cac86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a716bb98-0a4b-4e47-bd60-a67f14cac86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a00a7a8-dbbf-4ac8-8d1a-fa1605a36a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:49 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Volume 45fe572c-5053-48b9-a29d-94783814c518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fe572c-5053-48b9-a29d-94783814c518', 'volume_size': 1} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1778228877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fe572c-5053-48b9-a29d-94783814c518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce73c38b9b646d58f64d0855f6b6da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:33:50Z,use_quota=True,user_id='2f63ba0c38264a25b5950f4f3daf72a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Creating volume 45fe572c-5053-48b9-a29d-94783814c518 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:33:49 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:33:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:33:49 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 1073741824 Nov 06 19:33:49 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:33:50 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Nov 06 19:33:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 1073741824" returned: 0 in 1.039s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:33:51 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 Nov 06 19:33:51 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:33:51 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518" returned: 0 in 0.616s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a00a7a8-dbbf-4ac8-8d1a-fa1605a36a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fe572c-5053-48b9-a29d-94783814c518', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b6e00b-4142-4226-9e2d-796fb02b63f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:33:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Volume volume-45fe572c-5053-48b9-a29d-94783814c518 (45fe572c-5053-48b9-a29d-94783814c518): created successfully Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b6e00b-4142-4226-9e2d-796fb02b63f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:33:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Flow 'volume_create_manager' (1448626e-ab6e-4495-9443-286e07de7e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:33:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ea28d5fc-bcf3-4efc-b1f8-4e0fd522c246 tempest-DeleteServersTestJSON-1104757340 None] Created volume successfully. Nov 06 19:33:57 devstack cinder-volume[86928]: WARNING py.warnings [req-65ba09c7-26db-4fcb-9de9-e4a1c9e5bd05 req-c2dc1d2d-6598-417b-9e80-1c3616b9c096 tempest-DeleteServersTestJSON-1104757340 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 06 19:33:57 devstack cinder-volume[86928]: .first() Nov 06 19:33:57 devstack cinder-volume[86928]: Nov 06 19:33:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-65ba09c7-26db-4fcb-9de9-e4a1c9e5bd05 req-c2dc1d2d-6598-417b-9e80-1c3616b9c096 tempest-DeleteServersTestJSON-1104757340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:33:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-65ba09c7-26db-4fcb-9de9-e4a1c9e5bd05 req-c2dc1d2d-6598-417b-9e80-1c3616b9c096 tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:33:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-65ba09c7-26db-4fcb-9de9-e4a1c9e5bd05 req-c2dc1d2d-6598-417b-9e80-1c3616b9c096 tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:33:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-65ba09c7-26db-4fcb-9de9-e4a1c9e5bd05 req-c2dc1d2d-6598-417b-9e80-1c3616b9c096 tempest-DeleteServersTestJSON-1104757340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-45fe572c-5053-48b9-a29d-94783814c518', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '168cc53b-2c38-4647-bddd-7b676d2e6cde', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:33:57 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-65ba09c7-26db-4fcb-9de9-e4a1c9e5bd05 req-c2dc1d2d-6598-417b-9e80-1c3616b9c096 tempest-DeleteServersTestJSON-1104757340 None] attachment_update completed successfully. Nov 06 19:34:02 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:34:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Flow 'volume_create_manager' (26432951-636d-46d3-8693-26ce2bbb7b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:34:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a3c2e7-a53c-4503-935b-dfce25aa029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a3c2e7-a53c-4503-935b-dfce25aa029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1650211795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d238d658-b581-47f2-b269-65ff00db1078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9dd558077d482db1ba4b5230736274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:34:03Z,use_quota=True,user_id='45dde7d0330549d99db3e6a5f42716d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52355f5-3125-4241-b57e-40bd83e31c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52355f5-3125-4241-b57e-40bd83e31c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733aa726-3f54-4d73-87a9-921d4f0bcb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733aa726-3f54-4d73-87a9-921d4f0bcb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd238d658-b581-47f2-b269-65ff00db1078', 'volume_name': 'volume-d238d658-b581-47f2-b269-65ff00db1078', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5181fad8-e294-43aa-b9fd-b6b8862874e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5181fad8-e294-43aa-b9fd-b6b8862874e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f80ff-7d51-4511-82a9-08bbf1926f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:03 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Volume d238d658-b581-47f2-b269-65ff00db1078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d238d658-b581-47f2-b269-65ff00db1078', 'volume_size': 1} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1650211795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d238d658-b581-47f2-b269-65ff00db1078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9dd558077d482db1ba4b5230736274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:34:03Z,use_quota=True,user_id='45dde7d0330549d99db3e6a5f42716d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Creating volume d238d658-b581-47f2-b269-65ff00db1078 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:34:03 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:34:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:03 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 1073741824 Nov 06 19:34:03 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:04 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 1073741824" returned: 0 in 1.189s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:04 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 Nov 06 19:34:04 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:04 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078" returned: 0 in 0.464s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:34:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320f80ff-7d51-4511-82a9-08bbf1926f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d238d658-b581-47f2-b269-65ff00db1078', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70467258-90e2-44b8-9dec-f7b52680a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Volume volume-d238d658-b581-47f2-b269-65ff00db1078 (d238d658-b581-47f2-b269-65ff00db1078): created successfully Nov 06 19:34:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70467258-90e2-44b8-9dec-f7b52680a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Flow 'volume_create_manager' (26432951-636d-46d3-8693-26ce2bbb7b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:34:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8f436435-579f-4502-8352-398bca551c43 tempest-VolumesAdminNegativeTest-608303451 None] Created volume successfully. Nov 06 19:34:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-199dc7dc-bbe6-4a98-927f-f8b9f5f241e6 req-08aab242-c21f-4afa-87a5-c623843ffd30 tempest-DeleteServersTestJSON-1104757340 None] Terminate volume connection completed successfully. Nov 06 19:34:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-199dc7dc-bbe6-4a98-927f-f8b9f5f241e6 req-08aab242-c21f-4afa-87a5-c623843ffd30 tempest-DeleteServersTestJSON-1104757340 None] Deleting attachment 168cc53b-2c38-4647-bddd-7b676d2e6cde. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:34:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Acquiring lock "cinder-d238d658-b581-47f2-b269-65ff00db1078-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Lock "cinder-d238d658-b581-47f2-b269-65ff00db1078-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Acquiring lock "cinder-quobyte-d238d658-b581-47f2-b269-65ff00db1078" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Lock "cinder-quobyte-d238d658-b581-47f2-b269-65ff00db1078" acquired by "delete_volume" :: waited 0.039s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:07 devstack cinder-volume[86928]: INFO oslo.privsep.daemon [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn5zi_lg2/privsep.sock'] Nov 06 19:34:07 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn5zi_lg2/privsep.sock Nov 06 19:34:07 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 19:34:08 devstack cinder-volume[86928]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 19:34:09 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:09 devstack cinder-volume[86928]: INFO oslo.privsep.daemon [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Spawned new privsep daemon via rootwrap Nov 06 19:34:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Accepted privsep connection to /tmp/tmpn5zi_lg2/privsep.sock {{(pid=86928) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 19:34:09 devstack cinder-volume[86928]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 19:34:09 devstack cinder-volume[86928]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 19:34:09 devstack cinder-volume[86928]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 19:34:09 devstack cinder-volume[86928]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88585 Nov 06 19:34:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[23506376-0a85-40d4-8e07-6de6c9b0e1a9]: (2,) {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5439cabd-aaf8-4d41-bd12-33d6ad642cb9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:09 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 Nov 06 19:34:09 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:09 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078" returned: 0 in 0.858s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:09 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078 Nov 06 19:34:09 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:10 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d238d658-b581-47f2-b269-65ff00db1078" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Lock "cinder-quobyte-d238d658-b581-47f2-b269-65ff00db1078" released by "delete_volume" :: held 3.297s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:10 devstack cinder-volume[86928]: WARNING cinder.quota [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:34:10 devstack cinder-volume[86928]: WARNING cinder.quota [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Created reservations ['252f7d9d-eefc-4a69-95a8-ea60afe4cc29', '91213d4f-eb85-4902-857a-14aae7a59ed9', 'c0eca180-0a56-4441-9d4f-635d60ff0e31', 'bec865f2-7491-44fd-8282-ab3d924a3043'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:10 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:34:10 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:11 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.679s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:34:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Deleted volume successfully. Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25bf9f47-2f59-4af9-9a88-ec79fe02b1a9 tempest-VolumesAdminNegativeTest-608303451 None] Lock "cinder-d238d658-b581-47f2-b269-65ff00db1078-delete_volume" released by "delete_volume" :: held 4.580s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Acquiring lock "cinder-45fe572c-5053-48b9-a29d-94783814c518-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Lock "cinder-45fe572c-5053-48b9-a29d-94783814c518-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Acquiring lock "cinder-quobyte-45fe572c-5053-48b9-a29d-94783814c518" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Lock "cinder-quobyte-45fe572c-5053-48b9-a29d-94783814c518" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe6964c-f115-4434-9020-5c2f686dfbd2]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:12 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 Nov 06 19:34:12 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:12 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518" returned: 0 in 0.570s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:12 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518 Nov 06 19:34:12 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:12 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45fe572c-5053-48b9-a29d-94783814c518" returned: 0 in 0.454s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Lock "cinder-quobyte-45fe572c-5053-48b9-a29d-94783814c518" released by "delete_volume" :: held 1.106s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:12 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Created reservations ['ac399a9d-89a5-4eae-a812-35a56a8b08a7', '6a266f03-f296-498a-9ed2-24e7bbadfc47', 'ce1b3102-1387-4882-92cc-5ad93de6996c', 'aec73023-1b08-41b9-a4ef-c172bf19d91c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:13 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:34:13 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:13 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.439s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:34:13 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Deleted volume successfully. Nov 06 19:34:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-373ef776-5914-4332-95f9-a3eced83490d tempest-DeleteServersTestJSON-1104757340 None] Lock "cinder-45fe572c-5053-48b9-a29d-94783814c518-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:23 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:34:23 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Flow 'volume_create_manager' (0f3be77e-37bd-402a-8d3b-485d329989e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff117d1-2181-4881-9081-20e321b8b8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff117d1-2181-4881-9081-20e321b8b8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1287885099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7383d488-2c10-4b27-931f-78913c3f1591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd4abc472aa44e0a92679956be3dd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:34:26Z,use_quota=True,user_id='59a6a992403643ddaae50071f708ac04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2de629-a3b5-4454-a72a-861ae026018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2de629-a3b5-4454-a72a-861ae026018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb31b54-48af-432d-9131-472ae2773c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb31b54-48af-432d-9131-472ae2773c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7383d488-2c10-4b27-931f-78913c3f1591', 'volume_name': 'volume-7383d488-2c10-4b27-931f-78913c3f1591', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838a14d8-1e4b-4b28-99b2-9c2ac24cd437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838a14d8-1e4b-4b28-99b2-9c2ac24cd437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d758226-bfca-48ae-8a7f-fd296348fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Volume 7383d488-2c10-4b27-931f-78913c3f1591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7383d488-2c10-4b27-931f-78913c3f1591', 'volume_size': 1} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1287885099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7383d488-2c10-4b27-931f-78913c3f1591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd4abc472aa44e0a92679956be3dd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:34:26Z,use_quota=True,user_id='59a6a992403643ddaae50071f708ac04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Creating volume 7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:34:25 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:34:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:25 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 1073741824 Nov 06 19:34:25 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:26 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 1073741824" returned: 0 in 0.684s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:26 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 Nov 06 19:34:26 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:26 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591" returned: 0 in 0.299s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d758226-bfca-48ae-8a7f-fd296348fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7383d488-2c10-4b27-931f-78913c3f1591', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23092e68-5a13-4292-b9fc-45a5d82526b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:26 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Volume volume-7383d488-2c10-4b27-931f-78913c3f1591 (7383d488-2c10-4b27-931f-78913c3f1591): created successfully Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23092e68-5a13-4292-b9fc-45a5d82526b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Flow 'volume_create_manager' (0f3be77e-37bd-402a-8d3b-485d329989e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:34:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-ac9da93f-8144-492d-8ad7-94d135df2aff req-d505428d-39d4-46d8-b324-9574305d4239 tempest-VolumesSnapshotsTestJSON-1206859402 None] Created volume successfully. Nov 06 19:34:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Creating offline snapshot 8a6042d3-5049-4a0c-bdab-b0d56d8f0267 of volume 7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:34:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e5c75f-9e02-4a7d-ba60-e45baace7af1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:28 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 Nov 06 19:34:28 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:28 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:28 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 1G Nov 06 19:34:28 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:29 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 1G" returned: 0 in 0.599s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7383d488-2c10-4b27-931f-78913c3f1591 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:29 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7383d488-2c10-4b27-931f-78913c3f1591 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 Nov 06 19:34:29 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:29 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7383d488-2c10-4b27-931f-78913c3f1591 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267" returned: 0 in 0.369s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:29 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 is being set with open permissions: ugo+rw Nov 06 19:34:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:29 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 Nov 06 19:34:29 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:29 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267" returned: 0 in 0.237s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:29 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.info Nov 06 19:34:29 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:30 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.info" returned: 0 in 0.302s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:30 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.info is being set with open permissions: ugo+rw Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:30 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.info Nov 06 19:34:30 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:30 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.info" returned: 0 in 0.250s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-cb974504-aacb-4d6d-8dbe-03f7a176e5e5 req-40b897da-bb99-4161-9d54-77fdb40192a8 tempest-VolumesSnapshotsTestJSON-1206859402 None] Create snapshot completed successfully Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "cinder-8a6042d3-5049-4a0c-bdab-b0d56d8f0267-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-8a6042d3-5049-4a0c-bdab-b0d56d8f0267-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "cinder-quobyte-7383d488-2c10-4b27-931f-78913c3f1591" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-quobyte-7383d488-2c10-4b27-931f-78913c3f1591" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "cinder-quobyte-8a6042d3-5049-4a0c-bdab-b0d56d8f0267" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-quobyte-8a6042d3-5049-4a0c-bdab-b0d56d8f0267" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Deleting offline snapshot 8a6042d3-5049-4a0c-bdab-b0d56d8f0267 of volume 7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] snapshot_file for this snap is: volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684dc7c-f27a-4d2b-b237-d8916ca1af6b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:30 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 Nov 06 19:34:30 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:31 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267" returned: 0 in 0.451s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7383d488-2c10-4b27-931f-78913c3f1591(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:34:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd1801a-27db-4468-b98d-ff00cc0c7a9f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:31 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 Nov 06 19:34:31 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:31 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:31 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 Nov 06 19:34:31 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:32 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:32 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267 Nov 06 19:34:32 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:32 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591.8a6042d3-5049-4a0c-bdab-b0d56d8f0267" returned: 0 in 0.356s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-quobyte-8a6042d3-5049-4a0c-bdab-b0d56d8f0267" released by "_delete_snapshot" :: held 1.770s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-quobyte-7383d488-2c10-4b27-931f-78913c3f1591" released by "delete_snapshot" :: held 1.812s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:32 devstack cinder-volume[86928]: WARNING cinder.quota [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:34:32 devstack cinder-volume[86928]: DEBUG cinder.quota [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Created reservations ['622ecf7a-89fa-4247-973e-db10d4dfeeb6', '2dcbe577-8ac6-4914-b392-ab46281eba4a', '232d3ef7-0ea7-4d09-b74d-8c97a6a50401', '1da149ed-8526-485d-8789-39a95a5ff55a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:34:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Delete snapshot completed successfully. Nov 06 19:34:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-0e0fd5bf-e9c6-4224-8d42-d7b8cee0401b req-051bb488-b57f-48d4-850e-29e477870afd tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-8a6042d3-5049-4a0c-bdab-b0d56d8f0267-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "cinder-7383d488-2c10-4b27-931f-78913c3f1591-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-7383d488-2c10-4b27-931f-78913c3f1591-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "cinder-quobyte-7383d488-2c10-4b27-931f-78913c3f1591" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-quobyte-7383d488-2c10-4b27-931f-78913c3f1591" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba8f52d-0cc6-4e5f-a665-647d94697ef2]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:33 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 Nov 06 19:34:33 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:33 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591" returned: 0 in 0.543s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:33 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591 Nov 06 19:34:33 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:34 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7383d488-2c10-4b27-931f-78913c3f1591" returned: 0 in 0.323s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-quobyte-7383d488-2c10-4b27-931f-78913c3f1591" released by "delete_volume" :: held 0.970s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG cinder.quota [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Created reservations ['a2c82367-7019-4f39-a09f-60d71ffc69d4', '01060bf1-403f-4c82-b7b4-6d7e32bebeb3', 'e19be1ac-3f33-48f4-a86c-c79d28defbb9', '37aa99ab-cc83-4b7f-a965-af2e38e0bf5a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:34 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:34:34 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:34 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.390s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG cinder.manager [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:34:34 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Deleted volume successfully. Nov 06 19:34:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-b558df61-6877-483b-947e-02f44bf4b1ec req-ee5071ee-ccdf-40e6-92a3-5dc4900fa189 tempest-VolumesSnapshotsTestJSON-1206859402 None] Lock "cinder-7383d488-2c10-4b27-931f-78913c3f1591-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:34:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3a1dd381-81df-4d86-b230-c3bf91fefd1d req-eb569f67-16f6-43a0-903e-9cbaefb6d64d tempest-TaggedAttachmentsTest-716802486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3a1dd381-81df-4d86-b230-c3bf91fefd1d req-eb569f67-16f6-43a0-903e-9cbaefb6d64d tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3a1dd381-81df-4d86-b230-c3bf91fefd1d req-eb569f67-16f6-43a0-903e-9cbaefb6d64d tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-3a1dd381-81df-4d86-b230-c3bf91fefd1d req-eb569f67-16f6-43a0-903e-9cbaefb6d64d tempest-TaggedAttachmentsTest-716802486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-121233cf-bfff-4849-9e45-3b832fb50f63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf4a1871-a50e-4204-af41-4dc28e9404e6', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:34:41 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-3a1dd381-81df-4d86-b230-c3bf91fefd1d req-eb569f67-16f6-43a0-903e-9cbaefb6d64d tempest-TaggedAttachmentsTest-716802486 None] attachment_update completed successfully. Nov 06 19:34:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0e1ba570-3464-4c60-81dd-05dad2979ae6 tempest-GroupSnapshotsTest-773522939 None] Group tempest-GroupSnapshotsTest-Group-719024883: creating Nov 06 19:34:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0e1ba570-3464-4c60-81dd-05dad2979ae6 tempest-GroupSnapshotsTest-773522939 None] Group tempest-GroupSnapshotsTest-Group-719024883: created successfully Nov 06 19:34:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0e1ba570-3464-4c60-81dd-05dad2979ae6 tempest-GroupSnapshotsTest-773522939 None] Create group completed successfully. Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:47 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:34:47 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-959565e4-95f7-4250-99ec-122099def96e req-110ea173-7d87-4dfe-b3b7-8e10fa704414 tempest-TaggedAttachmentsTest-716802486 None] Terminate volume connection completed successfully. Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-959565e4-95f7-4250-99ec-122099def96e req-110ea173-7d87-4dfe-b3b7-8e10fa704414 tempest-TaggedAttachmentsTest-716802486 None] Deleting attachment bf4a1871-a50e-4204-af41-4dc28e9404e6. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:34:47 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.555s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 8 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:34:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (7f4a2938-8d05-414c-b5c2-432d8ea00a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39989124-bcb6-41e7-86c6-4987ea4e9bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39989124-bcb6-41e7-86c6-4987ea4e9bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-115444437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c67018b-a6e4-4fb1-8f90-54f8e3b7388b,host='devstack@QuobyteHD#QuobyteHD',id=f9324fc8-de4a-4ce5-9efa-b53ac7b3f380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:34:49Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4efcb8df-0800-4c6c-876e-1b97fcefd375),volume_type_id=4efcb8df-0800-4c6c-876e-1b97fcefd375)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150269c6-e54c-487f-bd82-84634b4cf418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150269c6-e54c-487f-bd82-84634b4cf418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05822ed8-ad57-4641-a1bf-202b35c2427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05822ed8-ad57-4641-a1bf-202b35c2427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9324fc8-de4a-4ce5-9efa-b53ac7b3f380', 'volume_name': 'volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec6c44d-a928-453c-9f91-6d4361ea8294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec6c44d-a928-453c-9f91-6d4361ea8294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65f3fb1-feda-4886-810c-e43b2ed4d916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:49 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Volume f9324fc8-de4a-4ce5-9efa-b53ac7b3f380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380', 'volume_size': 1} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c67018b-a6e4-4fb1-8f90-54f8e3b7388b,created_at=2026-11-06T18:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-115444437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c67018b-a6e4-4fb1-8f90-54f8e3b7388b,host='devstack@QuobyteHD#QuobyteHD',id=f9324fc8-de4a-4ce5-9efa-b53ac7b3f380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:34:49Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4efcb8df-0800-4c6c-876e-1b97fcefd375),volume_type_id=4efcb8df-0800-4c6c-876e-1b97fcefd375)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Creating volume f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:34:49 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:34:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:49 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 1073741824 Nov 06 19:34:49 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:50 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 1073741824" returned: 0 in 0.717s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:50 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 Nov 06 19:34:50 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:50 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" returned: 0 in 0.421s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65f3fb1-feda-4886-810c-e43b2ed4d916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a3a63c-080d-499f-9239-5f3b59570800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:34:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Volume volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 (f9324fc8-de4a-4ce5-9efa-b53ac7b3f380): created successfully Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a3a63c-080d-499f-9239-5f3b59570800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:34:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (7f4a2938-8d05-414c-b5c2-432d8ea00a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:34:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7e78263f-9a64-49e3-b9c1-54203360ff67 tempest-GroupSnapshotsTest-773522939 None] Created volume successfully. Nov 06 19:34:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] GroupSnapshot 2ece0f71-d04a-41ea-aa1c-8bcb5901cfa2: creating. Nov 06 19:34:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Group snapshot 2ece0f71-d04a-41ea-aa1c-8bcb5901cfa2: creating. {{(pid=86928) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 19:34:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Creating offline snapshot 71af96e8-38bf-4446-9101-2a59ff6c3c3b of volume f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:34:52 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[30753894-0123-4adc-b260-e5ef35bbc9af]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:52 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 Nov 06 19:34:52 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:53 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" returned: 0 in 0.669s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:53 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b 1G Nov 06 19:34:53 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:53 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b 1G" returned: 0 in 0.596s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:53 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b Nov 06 19:34:53 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:54 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b" returned: 0 in 0.424s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:54 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:34:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:54 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b Nov 06 19:34:54 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:54 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b" returned: 0 in 0.397s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:54 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.info Nov 06 19:34:54 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:54 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.info" returned: 0 in 0.367s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:54 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:34:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:54 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.info Nov 06 19:34:54 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:55 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.info" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.884s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2fd89a5e-292c-4d78-8000-1285bb5cb333 tempest-GroupSnapshotsTest-773522939 None] group_snapshot 2ece0f71-d04a-41ea-aa1c-8bcb5901cfa2: created successfully Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-71af96e8-38bf-4446-9101-2a59ff6c3c3b-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-71af96e8-38bf-4446-9101-2a59ff6c3c3b-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Creating volume c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 from snapshot 71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] snapshot: 71af96e8-38bf-4446-9101-2a59ff6c3c3b, volume: c5ba484a-9e5f-4fc1-bac9-fef70f9892d5, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:34:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb60434e-562d-4a66-b7d6-525e0ba88571]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:57 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b Nov 06 19:34:57 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:57 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b" returned: 0 in 0.832s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c4f0e-6992-4778-9ff1-7c426c3159cb]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:34:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:58 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 Nov 06 19:34:58 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:34:58 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Nov 06 19:34:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" returned: 0 in 0.744s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:34:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:34:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:34:58 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:34:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:34:58 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 Nov 06 19:34:58 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:06 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=37,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:35:06 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=29,cinder:SELECT=35,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:35:08 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" returned: 0 in 9.459s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:35:08 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Converted 1024.00 MB image at 108.25 MB/s Nov 06 19:35:08 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:08 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 Nov 06 19:35:08 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Acquiring lock "cinder-121233cf-bfff-4849-9e45-3b832fb50f63-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Lock "cinder-121233cf-bfff-4849-9e45-3b832fb50f63-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:08 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" returned: 0 in 0.405s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" released by "_copy_volume_from_snapshot" :: held 11.612s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Acquiring lock "cinder-quobyte-121233cf-bfff-4849-9e45-3b832fb50f63" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Lock "cinder-quobyte-121233cf-bfff-4849-9e45-3b832fb50f63" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e81b71c-1c3a-4a6b-b544-f7828a9e6bf4]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-71af96e8-38bf-4446-9101-2a59ff6c3c3b-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" released by "_create_volume_from_snapshot" :: held 11.875s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.902s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:08 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 Nov 06 19:35:08 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-53fd35ef-261d-4784-a59e-5e7d0fd3d3b1 tempest-GroupSnapshotsTest-773522939 None] Create group from source-snapshot-2ece0f71-d04a-41ea-aa1c-8bcb5901cfa2 completed successfully. Nov 06 19:35:09 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63" returned: 0 in 0.436s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:09 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63 Nov 06 19:35:09 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:09 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-121233cf-bfff-4849-9e45-3b832fb50f63" returned: 0 in 0.361s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Lock "cinder-quobyte-121233cf-bfff-4849-9e45-3b832fb50f63" released by "delete_volume" :: held 0.882s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Created reservations ['04a8eccd-d62a-4891-9ae5-6596fe99e8dc', 'eb8e7100-56ac-491e-8fba-14df7bd67a09', '9c5d06e6-28d1-4387-ba50-504204128ab6', '5044cb1f-45ef-4d14-bccd-d84bc917a84e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:09 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:35:09 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:10 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.331s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:35:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Deleted volume successfully. Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2e03d9eb-da62-4d2f-b469-5395b944088a tempest-TaggedAttachmentsTest-716802486 None] Lock "cinder-121233cf-bfff-4849-9e45-3b832fb50f63-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e9e68c-ee99-4e88-8771-ace439f3b34f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:10 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 Nov 06 19:35:10 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:10 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" returned: 0 in 0.455s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:10 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5 Nov 06 19:35:10 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:11 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" returned: 0 in 0.303s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-c5ba484a-9e5f-4fc1-bac9-fef70f9892d5" released by "delete_volume" :: held 0.828s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Created reservations ['6c1afa34-89fc-474b-9d31-a36aed5383ac'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:11 devstack cinder-volume[86928]: WARNING cinder.quota [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1193302883 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1193302883, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:35:11 devstack cinder-volume[86928]: WARNING cinder.quota [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1193302883 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1193302883, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Created reservations ['c306ae0b-b223-420a-ab1e-0ef7768721aa', 'ab1abe19-d7fe-4788-85e7-add08dc73cee', '4c9004b1-26f5-47a3-ab2d-ceca36dbce9d', '54b8ef96-8026-4886-a5d6-70d64cb8a674'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:11 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:35:11 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] group_snapshot 2ece0f71-d04a-41ea-aa1c-8bcb5901cfa2: deleting Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] group_snapshot 2ece0f71-d04a-41ea-aa1c-8bcb5901cfa2: deleting {{(pid=86928) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-71af96e8-38bf-4446-9101-2a59ff6c3c3b" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-71af96e8-38bf-4446-9101-2a59ff6c3c3b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:11 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Deleting offline snapshot 71af96e8-38bf-4446-9101-2a59ff6c3c3b of volume f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] snapshot_file for this snap is: volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.470s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:35:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ed585385-a9c6-421b-8d49-36cddc54848a tempest-GroupSnapshotsTest-773522939 None] Delete group completed successfully. Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b48fb2a-8235-4472-b126-a71c0f3fa31b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:12 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b Nov 06 19:35:12 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:12 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b" returned: 0 in 0.641s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:35:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9090c254-b400-4540-8c36-ce123661e169]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:12 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 Nov 06 19:35:12 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:13 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" returned: 0 in 0.752s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:13 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b Nov 06 19:35:13 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:13 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b" returned: 0 in 0.619s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:14 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b Nov 06 19:35:14 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:14 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380.71af96e8-38bf-4446-9101-2a59ff6c3c3b" returned: 0 in 0.301s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-71af96e8-38bf-4446-9101-2a59ff6c3c3b" released by "_delete_snapshot" :: held 2.598s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" released by "delete_snapshot" :: held 2.641s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:14 devstack cinder-volume[86928]: WARNING cinder.quota [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1193302883 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1193302883, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:35:14 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['5379c73c-f9b2-4c17-83cd-921ee68c58e4', 'adae0f95-1e61-409d-b4b5-6a71370904a3', '6c4daa90-de1f-4432-9bf6-289698dbf2c7', 'a78ae885-c8d4-4f2c-a806-d4531dcc1c98'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ca76cd40-ab15-4d09-8b38-412a04229a12 tempest-GroupSnapshotsTest-773522939 None] group_snapshot 2ece0f71-d04a-41ea-aa1c-8bcb5901cfa2: deleted successfully Nov 06 19:35:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:15 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0214c1e6-a259-46f5-abc6-07b15c599da3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:15 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 Nov 06 19:35:15 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:16 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" returned: 0 in 0.535s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:16 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380 Nov 06 19:35:16 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:16 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-f9324fc8-de4a-4ce5-9efa-b53ac7b3f380" released by "delete_volume" :: held 1.008s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['22650428-7ef7-4fef-8636-b3436008d857'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:16 devstack cinder-volume[86928]: WARNING cinder.db.api [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1193302883'] Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['5b3a9eb3-2631-45bb-ab66-ef2a71a143fb', '16a02563-d1e4-4106-98c6-46c1d7de9bbf', 'a58ce248-1fd7-4387-802f-bd836adc0dba', 'b3b31a3b-49d4-4a66-9b44-0b75f16f87ae'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:16 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:35:16 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:17 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.429s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:17 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:35:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-eeaf3e08-3260-476a-8072-c3671a4791e7 tempest-GroupSnapshotsTest-773522939 None] Delete group completed successfully. Nov 06 19:35:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7f27aa83-7a61-46ad-9490-ca19f2a33cde tempest-GroupSnapshotsTest-773522939 None] Group tempest-GroupSnapshotsTest-Group-1206072983: creating Nov 06 19:35:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7f27aa83-7a61-46ad-9490-ca19f2a33cde tempest-GroupSnapshotsTest-773522939 None] Group tempest-GroupSnapshotsTest-Group-1206072983: created successfully Nov 06 19:35:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7f27aa83-7a61-46ad-9490-ca19f2a33cde tempest-GroupSnapshotsTest-773522939 None] Create group completed successfully. Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Flow 'volume_create_manager' (53d2eb6d-e7c9-4c39-8d75-e52dc722278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9bc899-400b-49f1-9e12-7887cb0cb486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9bc899-400b-49f1-9e12-7887cb0cb486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1011092336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c992059-91b6-4cc0-9ce7-888c940e08fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b63e3e08b048f5b6ff27b95f76f36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:18Z,use_quota=True,user_id='71993c84c6b84fbc977547f6d7451b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3288b32c-f3c4-4fd0-9453-55317a9351d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3288b32c-f3c4-4fd0-9453-55317a9351d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a86517-4941-4149-bfce-bde5427aa703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a86517-4941-4149-bfce-bde5427aa703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c992059-91b6-4cc0-9ce7-888c940e08fa', 'volume_name': 'volume-4c992059-91b6-4cc0-9ce7-888c940e08fa', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c641a7c6-4c6d-48ce-abc8-bb9a8b33362b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c641a7c6-4c6d-48ce-abc8-bb9a8b33362b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec35ae6-72ff-457d-b1a7-6bed05f4ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Volume 4c992059-91b6-4cc0-9ce7-888c940e08fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c992059-91b6-4cc0-9ce7-888c940e08fa', 'volume_size': 1} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1011092336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c992059-91b6-4cc0-9ce7-888c940e08fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b63e3e08b048f5b6ff27b95f76f36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:18Z,use_quota=True,user_id='71993c84c6b84fbc977547f6d7451b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Creating volume 4c992059-91b6-4cc0-9ce7-888c940e08fa {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:35:18 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:35:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:18 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa 1073741824 Nov 06 19:35:18 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:19 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa 1073741824" returned: 0 in 0.725s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:19 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa Nov 06 19:35:19 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:19 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa" returned: 0 in 0.329s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec35ae6-72ff-457d-b1a7-6bed05f4ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c992059-91b6-4cc0-9ce7-888c940e08fa', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb3a65e-96f4-46e7-b75b-e577730fd5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:19 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Volume volume-4c992059-91b6-4cc0-9ce7-888c940e08fa (4c992059-91b6-4cc0-9ce7-888c940e08fa): created successfully Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb3a65e-96f4-46e7-b75b-e577730fd5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Flow 'volume_create_manager' (53d2eb6d-e7c9-4c39-8d75-e52dc722278e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:19 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fce0d1b9-af92-43fb-860c-b8c3cb744c35 tempest-ServerActionsTestOtherA-1075691181 None] Created volume successfully. Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (89ca6071-0f88-4dc5-82e6-8331bb2b8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc91663f-8e44-4cd5-9307-e474b1eeb74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc91663f-8e44-4cd5-9307-e474b1eeb74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848359892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cae1c2f-56d7-43b9-8cad-06fd8a4fd5ae,host='devstack@QuobyteHD#QuobyteHD',id=56836250-356a-495c-9ff7-dd7f75fdf391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:20Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2df4d885-b496-41a4-a1d1-87c4e22d7833),volume_type_id=2df4d885-b496-41a4-a1d1-87c4e22d7833)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665a4105-e06f-4552-9553-d3e182464b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665a4105-e06f-4552-9553-d3e182464b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86143522-00a4-482f-ad68-5d849ae40214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86143522-00a4-482f-ad68-5d849ae40214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56836250-356a-495c-9ff7-dd7f75fdf391', 'volume_name': 'volume-56836250-356a-495c-9ff7-dd7f75fdf391', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380da90b-d403-4b23-b7e0-48cee2acc8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380da90b-d403-4b23-b7e0-48cee2acc8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b15734-194a-471d-9037-ca4a1c90e037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:20 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Volume 56836250-356a-495c-9ff7-dd7f75fdf391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56836250-356a-495c-9ff7-dd7f75fdf391', 'volume_size': 1} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5cae1c2f-56d7-43b9-8cad-06fd8a4fd5ae,created_at=2026-11-06T18:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848359892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cae1c2f-56d7-43b9-8cad-06fd8a4fd5ae,host='devstack@QuobyteHD#QuobyteHD',id=56836250-356a-495c-9ff7-dd7f75fdf391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:20Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2df4d885-b496-41a4-a1d1-87c4e22d7833),volume_type_id=2df4d885-b496-41a4-a1d1-87c4e22d7833)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Creating volume 56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:35:20 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:20 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 1073741824 Nov 06 19:35:20 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:20 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 1073741824" returned: 0 in 0.576s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:20 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 Nov 06 19:35:20 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:21 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:35:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b15734-194a-471d-9037-ca4a1c90e037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56836250-356a-495c-9ff7-dd7f75fdf391', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc920ef5-0e6a-43a8-9308-bce2c5661a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:21 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Volume volume-56836250-356a-495c-9ff7-dd7f75fdf391 (56836250-356a-495c-9ff7-dd7f75fdf391): created successfully Nov 06 19:35:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc920ef5-0e6a-43a8-9308-bce2c5661a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (89ca6071-0f88-4dc5-82e6-8331bb2b8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-77d8241b-6ee0-42f5-ad71-eeb510fa2274 tempest-GroupSnapshotsTest-773522939 None] Created volume successfully. Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (ad7ab88c-0e89-41e6-b6c2-c3c250c34528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179b34b4-44cb-46f8-9572-cd3eea7cf972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179b34b4-44cb-46f8-9572-cd3eea7cf972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283854761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cae1c2f-56d7-43b9-8cad-06fd8a4fd5ae,host='devstack@QuobyteHD#QuobyteHD',id=57d856c0-a0bb-4baa-bb0f-ab32f4944927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:22Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2df4d885-b496-41a4-a1d1-87c4e22d7833),volume_type_id=2df4d885-b496-41a4-a1d1-87c4e22d7833)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faed815-71d4-4109-83c3-ecea55dd9f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faed815-71d4-4109-83c3-ecea55dd9f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8de34e6-f3e2-49ef-a52f-56f61bb9e581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8de34e6-f3e2-49ef-a52f-56f61bb9e581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d856c0-a0bb-4baa-bb0f-ab32f4944927', 'volume_name': 'volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df92489-615a-4fa9-9389-0e47df986cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df92489-615a-4fa9-9389-0e47df986cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eee15ca-4994-4c69-b932-280ff92923a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:22 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Volume 57d856c0-a0bb-4baa-bb0f-ab32f4944927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927', 'volume_size': 1} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5cae1c2f-56d7-43b9-8cad-06fd8a4fd5ae,created_at=2026-11-06T18:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283854761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cae1c2f-56d7-43b9-8cad-06fd8a4fd5ae,host='devstack@QuobyteHD#QuobyteHD',id=57d856c0-a0bb-4baa-bb0f-ab32f4944927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:22Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2df4d885-b496-41a4-a1d1-87c4e22d7833),volume_type_id=2df4d885-b496-41a4-a1d1-87c4e22d7833)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Creating volume 57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:35:22 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:22 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 1073741824 Nov 06 19:35:22 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:22 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 1073741824" returned: 0 in 0.591s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:22 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 Nov 06 19:35:23 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:23 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927" returned: 0 in 0.281s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:35:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eee15ca-4994-4c69-b932-280ff92923a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd1d5c5-abe1-4e1e-9cb8-20f25b8b7401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:23 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Volume volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 (57d856c0-a0bb-4baa-bb0f-ab32f4944927): created successfully Nov 06 19:35:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd1d5c5-abe1-4e1e-9cb8-20f25b8b7401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (ad7ab88c-0e89-41e6-b6c2-c3c250c34528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:23 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4789123a-df19-4be6-b3f8-78031a617cb0 tempest-GroupSnapshotsTest-773522939 None] Created volume successfully. Nov 06 19:35:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-03efe83c-f514-47df-8baa-4a901a3b5945 tempest-GroupSnapshotsTest-773522939 None] Update group completed successfully. Nov 06 19:35:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9bacf7fa-98d0-449b-823d-ea5860f68d65 tempest-GroupSnapshotsTest-773522939 None] Update group completed successfully. Nov 06 19:35:27 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-76825bd4-1a5e-423c-85cd-5a74868d29cc tempest-GroupSnapshotsTest-773522939 None] Update group completed successfully. Nov 06 19:35:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d50a9755-8722-48f5-8c9d-60bc300f35e1 tempest-GroupSnapshotsTest-773522939 None] Update group completed successfully. Nov 06 19:35:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] GroupSnapshot abd2912d-72c6-4a6b-a725-cd8c90aa338e: creating. Nov 06 19:35:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Group snapshot abd2912d-72c6-4a6b-a725-cd8c90aa338e: creating. {{(pid=86928) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 19:35:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Creating offline snapshot 0b0a21ff-ae2f-4a9a-b775-4bc176453698 of volume 57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:35:30 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be592e67-1952-4d39-8851-1da9fb0a0ff1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:30 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 Nov 06 19:35:30 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:31 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927" returned: 0 in 0.556s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:31 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 1G Nov 06 19:35:31 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:32 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 1G" returned: 0 in 0.676s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:32 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 Nov 06 19:35:32 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:32 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698" returned: 0 in 0.584s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:32 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:35:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:32 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 Nov 06 19:35:32 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:32 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698" returned: 0 in 0.338s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:32 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.info Nov 06 19:35:33 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:33 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.info" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:33 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:33 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.info Nov 06 19:35:33 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:33 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.info" returned: 0 in 0.270s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Creating offline snapshot 6f771cb4-805f-4fe5-80f4-94e3374a1816 of volume 56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdacfcba-1647-477e-b586-ee368853cb6e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:33 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 Nov 06 19:35:33 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:34 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391" returned: 0 in 0.498s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:34 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 1G Nov 06 19:35:34 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:34 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 1G" returned: 0 in 0.463s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56836250-356a-495c-9ff7-dd7f75fdf391 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:34 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56836250-356a-495c-9ff7-dd7f75fdf391 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 Nov 06 19:35:34 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:34 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56836250-356a-495c-9ff7-dd7f75fdf391 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816" returned: 0 in 0.392s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:34 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:35:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:35 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 Nov 06 19:35:35 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:35 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816" returned: 0 in 0.275s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:35 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.info Nov 06 19:35:35 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:35 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.info" returned: 0 in 0.296s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:35 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:35:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:35 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.info Nov 06 19:35:35 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:35 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.info" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-84a1f77b-b756-4fd6-a419-947490595b30 tempest-GroupSnapshotsTest-773522939 None] group_snapshot abd2912d-72c6-4a6b-a725-cd8c90aa338e: created successfully Nov 06 19:35:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] group_snapshot abd2912d-72c6-4a6b-a725-cd8c90aa338e: deleting Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] group_snapshot abd2912d-72c6-4a6b-a725-cd8c90aa338e: deleting {{(pid=86928) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Flow 'volume_create_manager' (6aad643e-a52f-419c-b5d7-0375d86ca301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23520af4-56e5-4e81-a1be-b84eeeb1301c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-57d856c0-a0bb-4baa-bb0f-ab32f4944927" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23520af4-56e5-4e81-a1be-b84eeeb1301c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-429255281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7ee59b-b7ba-4e67-b5f5-7e3220c43673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf3b219eec4d72b5c4fb7a3a4ea973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:37Z,use_quota=True,user_id='e751589471aa4ab48a4a329183c43e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f791ba3e-0c0f-482c-89f9-e00628978544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f791ba3e-0c0f-482c-89f9-e00628978544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71878164-18e7-4dcb-96c0-b7881a6ffe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71878164-18e7-4dcb-96c0-b7881a6ffe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7ee59b-b7ba-4e67-b5f5-7e3220c43673', 'volume_name': 'volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9132efd2-4f52-4f74-8cd0-ce06421e55d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9132efd2-4f52-4f74-8cd0-ce06421e55d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec98692-2534-415d-b3e9-2e46693002d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Volume 5a7ee59b-b7ba-4e67-b5f5-7e3220c43673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673', 'volume_size': 1} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-429255281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7ee59b-b7ba-4e67-b5f5-7e3220c43673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf3b219eec4d72b5c4fb7a3a4ea973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:37Z,use_quota=True,user_id='e751589471aa4ab48a4a329183c43e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Creating volume 5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:35:37 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-57d856c0-a0bb-4baa-bb0f-ab32f4944927" acquired by "delete_snapshot" :: waited 0.103s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-0b0a21ff-ae2f-4a9a-b775-4bc176453698" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-0b0a21ff-ae2f-4a9a-b775-4bc176453698" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Deleting offline snapshot 0b0a21ff-ae2f-4a9a-b775-4bc176453698 of volume 57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:35:37 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 1073741824 Nov 06 19:35:37 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] snapshot_file for this snap is: volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4badd05-72b4-45c5-8b98-9feefd8aa08b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:38 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 Nov 06 19:35:38 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:38 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dac1c3d-d99e-454f-be03-0661f8e49470]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:38 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 1073741824" returned: 0 in 0.754s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:38 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 Nov 06 19:35:38 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:38 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 Nov 06 19:35:38 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:38 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673" returned: 0 in 0.292s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec98692-2534-415d-b3e9-2e46693002d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e73971b-e0db-43fa-819c-0e257ba9978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:38 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Volume volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 (5a7ee59b-b7ba-4e67-b5f5-7e3220c43673): created successfully Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e73971b-e0db-43fa-819c-0e257ba9978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Flow 'volume_create_manager' (6aad643e-a52f-419c-b5d7-0375d86ca301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8bf208bb-171e-477c-bb5c-2843e20aadec tempest-AttachVolumeTestJSON-567700193 None] Created volume successfully. Nov 06 19:35:38 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927" returned: 0 in 0.491s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:38 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 Nov 06 19:35:38 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:39 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698" returned: 0 in 0.386s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:39 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698 Nov 06 19:35:39 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:39 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927.0b0a21ff-ae2f-4a9a-b775-4bc176453698" returned: 0 in 0.343s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-0b0a21ff-ae2f-4a9a-b775-4bc176453698" released by "_delete_snapshot" :: held 1.967s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-57d856c0-a0bb-4baa-bb0f-ab32f4944927" released by "delete_snapshot" :: held 2.006s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-56836250-356a-495c-9ff7-dd7f75fdf391" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-56836250-356a-495c-9ff7-dd7f75fdf391" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-6f771cb4-805f-4fe5-80f4-94e3374a1816" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-6f771cb4-805f-4fe5-80f4-94e3374a1816" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Deleting offline snapshot 6f771cb4-805f-4fe5-80f4-94e3374a1816 of volume 56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] snapshot_file for this snap is: volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[17620d29-68cf-47f4-82b7-e990bf6c6b77]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:40 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 Nov 06 19:35:40 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:40 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816" returned: 0 in 0.642s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56836250-356a-495c-9ff7-dd7f75fdf391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e86108-bec7-4956-b17a-b24be1fe078c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:40 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 Nov 06 19:35:40 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-6bdfce9c-9715-4f56-9a54-9d5ba989c95f req-1ba97057-6370-4401-9f75-809645932e12 tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-6bdfce9c-9715-4f56-9a54-9d5ba989c95f req-1ba97057-6370-4401-9f75-809645932e12 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-6bdfce9c-9715-4f56-9a54-9d5ba989c95f req-1ba97057-6370-4401-9f75-809645932e12 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-6bdfce9c-9715-4f56-9a54-9d5ba989c95f req-1ba97057-6370-4401-9f75-809645932e12 tempest-AttachVolumeTestJSON-567700193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed3d1d5b-9323-425f-ae17-3a11e364ddea', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:35:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-6bdfce9c-9715-4f56-9a54-9d5ba989c95f req-1ba97057-6370-4401-9f75-809645932e12 tempest-AttachVolumeTestJSON-567700193 None] attachment_update completed successfully. Nov 06 19:35:41 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391" returned: 0 in 0.565s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:41 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 Nov 06 19:35:41 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:41 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816" returned: 0 in 0.516s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:41 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816 Nov 06 19:35:41 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:42 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391.6f771cb4-805f-4fe5-80f4-94e3374a1816" returned: 0 in 0.421s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-6f771cb4-805f-4fe5-80f4-94e3374a1816" released by "_delete_snapshot" :: held 2.327s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-56836250-356a-495c-9ff7-dd7f75fdf391" released by "delete_snapshot" :: held 2.360s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:42 devstack cinder-volume[86928]: WARNING cinder.quota [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-173466765 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-173466765, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:35:42 devstack cinder-volume[86928]: WARNING cinder.quota [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-173466765 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-173466765, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:35:42 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['9891a5e7-a071-49b3-913b-31318f090ef5', 'b4a967fd-a7f1-41cf-9d7d-b75bf6a50ec4', '858e8531-0c24-49b1-84c1-715c496c488a', '5a32d4ea-5b03-44b8-ac45-9f4905280bb3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:42 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['6868454e-15c2-464c-bac1-5c01cfbfeec0', 'e287ec63-ed09-439e-8844-d96f859f09e6', 'ee23d9cb-ebe7-4ec1-b670-eefc90f72e76', 'dc6e0bc6-4174-4ccb-9181-4e680aaac81c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:42 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-19a383a7-3e32-411a-a46d-f1d71151fce2 tempest-GroupSnapshotsTest-773522939 None] group_snapshot abd2912d-72c6-4a6b-a725-cd8c90aa338e: deleted successfully Nov 06 19:35:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-56836250-356a-495c-9ff7-dd7f75fdf391" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-56836250-356a-495c-9ff7-dd7f75fdf391" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1660ff-e1d7-4166-92b6-6ffc80d4cecf]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:44 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 Nov 06 19:35:44 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:44 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391" returned: 0 in 0.393s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:44 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391 Nov 06 19:35:44 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:44 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-56836250-356a-495c-9ff7-dd7f75fdf391" returned: 0 in 0.292s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-56836250-356a-495c-9ff7-dd7f75fdf391" released by "delete_volume" :: held 0.776s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-57d856c0-a0bb-4baa-bb0f-ab32f4944927" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-57d856c0-a0bb-4baa-bb0f-ab32f4944927" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e896847-2723-494e-b7f7-26c815303aed]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:44 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 Nov 06 19:35:44 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:45 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927" returned: 0 in 0.413s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:45 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927 Nov 06 19:35:45 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:45 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-57d856c0-a0bb-4baa-bb0f-ab32f4944927" returned: 0 in 0.396s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-57d856c0-a0bb-4baa-bb0f-ab32f4944927" released by "delete_volume" :: held 0.903s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:35:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['a14600b4-d0b5-4806-ae12-9a1558c063a1'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:45 devstack cinder-volume[86928]: WARNING cinder.quota [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-173466765 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-173466765, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:35:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['b080c458-92f0-488c-b9bf-535ca389d2c0', 'cab08ade-5062-4e16-b3fc-40c7d4e72a35', '327fc7ed-1690-4108-b01f-82e7679d617c', 'ff39ed52-f476-4fd6-9bea-800fc0145b76'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Created reservations ['8a3f8656-26bf-43d3-8c00-bfa736ec3e80', '7d7fe91b-0a9b-431d-b8b0-450649e8d383', 'f91128ea-e4b3-4868-aa91-1f851e1f72ee', '05af7844-e38e-477f-b94f-043e1f2073f2'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:46 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:35:46 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:46 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.375s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:46 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:35:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-45db49b9-07c0-448b-a909-367c418f7ea3 tempest-GroupSnapshotsTest-773522939 None] Delete group completed successfully. Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a181b56a-9c70-4e99-9103-9b1a059eb6ac tempest-GroupSnapshotsTest-773522939 None] Group tempest-GroupSnapshotsTest-Group-2062535061: creating Nov 06 19:35:47 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:35:47 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a181b56a-9c70-4e99-9103-9b1a059eb6ac tempest-GroupSnapshotsTest-773522939 None] Group tempest-GroupSnapshotsTest-Group-2062535061: created successfully Nov 06 19:35:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a181b56a-9c70-4e99-9103-9b1a059eb6ac tempest-GroupSnapshotsTest-773522939 None] Create group completed successfully. Nov 06 19:35:47 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.481s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 8 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:35:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (a461985e-871a-472f-b6b4-b55de75bd856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b0f170-c506-40c3-a9b2-4c9964d6a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b0f170-c506-40c3-a9b2-4c9964d6a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214077568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15cb1ddb-30af-4b7c-8e0d-ca85e32fa2a3,host='devstack@QuobyteHD#QuobyteHD',id=60dfed0d-cc9a-47b0-b344-1a2cf11e5d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:49Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a073c8c5-b9ba-431e-8776-5be9b7415ba8),volume_type_id=a073c8c5-b9ba-431e-8776-5be9b7415ba8)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8529acc-e4ad-48fd-abc3-2b0a68a541bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8529acc-e4ad-48fd-abc3-2b0a68a541bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5e6903-2d31-46d2-9c55-cd14bd770134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5e6903-2d31-46d2-9c55-cd14bd770134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60dfed0d-cc9a-47b0-b344-1a2cf11e5d43', 'volume_name': 'volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c435ab2-67cf-4fcc-8fbe-9e75cf3798bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c435ab2-67cf-4fcc-8fbe-9e75cf3798bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0044673-33c4-4254-ba0a-ae60fea7770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:49 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Volume 60dfed0d-cc9a-47b0-b344-1a2cf11e5d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43', 'volume_size': 1} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15cb1ddb-30af-4b7c-8e0d-ca85e32fa2a3,created_at=2026-11-06T18:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214077568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15cb1ddb-30af-4b7c-8e0d-ca85e32fa2a3,host='devstack@QuobyteHD#QuobyteHD',id=60dfed0d-cc9a-47b0-b344-1a2cf11e5d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf7a9fd082e4becafa4f4cc3136b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:35:49Z,use_quota=True,user_id='7363aa5c88e341319e3c9dcc1b396db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a073c8c5-b9ba-431e-8776-5be9b7415ba8),volume_type_id=a073c8c5-b9ba-431e-8776-5be9b7415ba8)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Creating volume 60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:35:49 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:35:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:49 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 1073741824 Nov 06 19:35:49 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:50 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 1073741824" returned: 0 in 0.910s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:50 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 Nov 06 19:35:50 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:51 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" returned: 0 in 0.310s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:35:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0044673-33c4-4254-ba0a-ae60fea7770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa81be01-3a6a-47ea-af29-2a09a73db850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:35:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Volume volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 (60dfed0d-cc9a-47b0-b344-1a2cf11e5d43): created successfully Nov 06 19:35:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa81be01-3a6a-47ea-af29-2a09a73db850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:35:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Flow 'volume_create_manager' (a461985e-871a-472f-b6b4-b55de75bd856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:35:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9e47131f-eb5e-452d-ab38-5870b556930a tempest-GroupSnapshotsTest-773522939 None] Created volume successfully. Nov 06 19:35:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] GroupSnapshot d961d864-e782-4e0c-b1ed-ae0035ee038e: creating. Nov 06 19:35:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Group snapshot d961d864-e782-4e0c-b1ed-ae0035ee038e: creating. {{(pid=86928) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 19:35:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:35:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:35:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Creating offline snapshot ba07f3e8-2cc4-4099-af26-30a586cdcceb of volume 60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:35:52 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf07f44d-f93e-4abb-bf29-9eb3b785a3a7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:53 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 Nov 06 19:35:53 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" returned: 0 in 0.783s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:53 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:53 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb 1G Nov 06 19:35:53 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:55 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb 1G" returned: 0 in 1.392s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:55 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb Nov 06 19:35:55 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:55 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb" returned: 0 in 0.494s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:55 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:35:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:55 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb Nov 06 19:35:55 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:56 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:56 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.info Nov 06 19:35:56 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:57 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.info" returned: 0 in 0.976s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:57 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:35:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:57 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.info Nov 06 19:35:57 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:57 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.info" returned: 0 in 0.724s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.118s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:35:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ad609cfd-b3cc-45e2-a534-7949c0d7d1b7 tempest-GroupSnapshotsTest-773522939 None] group_snapshot d961d864-e782-4e0c-b1ed-ae0035ee038e: created successfully Nov 06 19:35:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] group_snapshot d961d864-e782-4e0c-b1ed-ae0035ee038e: deleting Nov 06 19:35:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] group_snapshot d961d864-e782-4e0c-b1ed-ae0035ee038e: deleting {{(pid=86928) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 19:35:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-ba07f3e8-2cc4-4099-af26-30a586cdcceb" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:35:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-ba07f3e8-2cc4-4099-af26-30a586cdcceb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:35:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Deleting offline snapshot ba07f3e8-2cc4-4099-af26-30a586cdcceb of volume 60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:35:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] snapshot_file for this snap is: volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:35:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd2df3c-e897-4c2b-9050-012b90344706]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:35:59 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb Nov 06 19:35:59 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:35:59 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Nov 06 19:35:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb" returned: 0 in 0.872s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:35:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:35:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b111d4a6-1569-4237-ae24-925e67e09812]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:35:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-6c780c47-59ba-4bc1-b88b-b15dad2291a2 req-c2eafbef-1a17-451a-a5f3-7073fc34ded9 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-6c780c47-59ba-4bc1-b88b-b15dad2291a2 req-c2eafbef-1a17-451a-a5f3-7073fc34ded9 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-6c780c47-59ba-4bc1-b88b-b15dad2291a2 req-c2eafbef-1a17-451a-a5f3-7073fc34ded9 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:00 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 Nov 06 19:36:00 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-6c780c47-59ba-4bc1-b88b-b15dad2291a2 req-c2eafbef-1a17-451a-a5f3-7073fc34ded9 tempest-ServerActionsTestOtherA-1075691181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-4c992059-91b6-4cc0-9ce7-888c940e08fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b89d548e-d226-4ae8-abfd-4825c45ed928', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:36:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-6c780c47-59ba-4bc1-b88b-b15dad2291a2 req-c2eafbef-1a17-451a-a5f3-7073fc34ded9 tempest-ServerActionsTestOtherA-1075691181 None] attachment_update completed successfully. Nov 06 19:36:00 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" returned: 0 in 0.552s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:00 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb Nov 06 19:36:00 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:01 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb" returned: 0 in 0.592s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:01 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb Nov 06 19:36:01 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:01 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43.ba07f3e8-2cc4-4099-af26-30a586cdcceb" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-ba07f3e8-2cc4-4099-af26-30a586cdcceb" released by "_delete_snapshot" :: held 2.816s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" released by "delete_snapshot" :: held 2.879s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:01 devstack cinder-volume[86928]: WARNING cinder.quota [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-731823877 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-731823877, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:36:01 devstack cinder-volume[86928]: WARNING cinder.quota [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-731823877 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-731823877, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:36:01 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] Created reservations ['7f2c9b07-cc68-499a-9db7-de08c5d02f9e', '14301c2b-92fb-44d8-8de1-88b83c51fe3a', '4d79b17a-a0f9-49c8-b54b-d7975d558948', '4c0a8c94-292f-45a7-b4a2-c8ee9c8e4d1c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9840db10-4702-476d-a33a-1a0a478e084f tempest-GroupSnapshotsTest-773522939 None] group_snapshot d961d864-e782-4e0c-b1ed-ae0035ee038e: deleted successfully Nov 06 19:36:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "cinder-quobyte-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:36:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:36:03 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc9e46-4e2c-4712-8456-3ab3a0e530a4]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:36:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:03 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 Nov 06 19:36:03 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:04 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" returned: 0 in 0.803s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:04 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43 Nov 06 19:36:04 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:04 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" returned: 0 in 0.745s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Lock "cinder-quobyte-60dfed0d-cc9a-47b0-b344-1a2cf11e5d43" released by "delete_volume" :: held 1.762s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Created reservations ['9e7b7901-5961-44b6-92cd-62d62e64ee90'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:05 devstack cinder-volume[86928]: WARNING cinder.quota [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-731823877 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-731823877, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Created reservations ['dfa4852f-3fef-4c22-98f1-7dea672b8f68', 'cb44a813-9ec1-48a8-a8cb-ac7d521fc31e', '85d8360c-1e8e-4564-9604-c652fbe4533d', '0ea85c47-3f01-4317-b16d-a19acee9a19f'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:05 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:36:05 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-d3d42856-e836-448c-aa57-42098690ad37 req-30a3dda1-b714-4e90-95a8-c2e627feb58a tempest-ServerActionsTestOtherA-1075691181 None] Terminate volume connection completed successfully. Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-d3d42856-e836-448c-aa57-42098690ad37 req-30a3dda1-b714-4e90-95a8-c2e627feb58a tempest-ServerActionsTestOtherA-1075691181 None] Deleting attachment b89d548e-d226-4ae8-abfd-4825c45ed928. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:36:05 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.405s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:05 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:36:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-152d71bb-d0a5-4837-a715-97b4df84397e tempest-GroupSnapshotsTest-773522939 None] Delete group completed successfully. Nov 06 19:36:07 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=115,cinder:SELECT=119,cinder:INSERT=26,cinder:DELETE=3 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:36:07 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=124,cinder:INSERT=27,cinder:UPDATE=115,cinder:DELETE=3 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:36:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-d3d42856-e836-448c-aa57-42098690ad37 req-67412bbd-cbfe-4da1-a67e-6f8b131a6aa2 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-d3d42856-e836-448c-aa57-42098690ad37 req-67412bbd-cbfe-4da1-a67e-6f8b131a6aa2 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-d3d42856-e836-448c-aa57-42098690ad37 req-67412bbd-cbfe-4da1-a67e-6f8b131a6aa2 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-d3d42856-e836-448c-aa57-42098690ad37 req-67412bbd-cbfe-4da1-a67e-6f8b131a6aa2 tempest-ServerActionsTestOtherA-1075691181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-4c992059-91b6-4cc0-9ce7-888c940e08fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8897bec-fcc3-4699-887d-cb558f451109', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:36:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-d3d42856-e836-448c-aa57-42098690ad37 req-67412bbd-cbfe-4da1-a67e-6f8b131a6aa2 tempest-ServerActionsTestOtherA-1075691181 None] attachment_update completed successfully. Nov 06 19:36:10 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:36:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Flow 'volume_create_manager' (97945c35-8986-4e0d-9bbd-37623125ea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66899ee7-74c3-4d3f-a3bb-f749ecef1a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66899ee7-74c3-4d3f-a3bb-f749ecef1a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-357637900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5452ea7f-2372-47a0-9e8b-4e591aedc1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100ea3ba4d63411985b20e65ececac71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:11Z,use_quota=True,user_id='1e451778c8e0443698bc6815f731abeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e5d3d0-3b73-40f7-9db2-a3c008e9e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e5d3d0-3b73-40f7-9db2-a3c008e9e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14dfb65-438e-4ac1-9dc7-209b247cc995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14dfb65-438e-4ac1-9dc7-209b247cc995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5452ea7f-2372-47a0-9e8b-4e591aedc1de', 'volume_name': 'volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f50d07-c06b-41bf-9c54-151c6e755a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f50d07-c06b-41bf-9c54-151c6e755a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103e43e4-ce23-4279-8ca5-72557c8bb4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Volume 5452ea7f-2372-47a0-9e8b-4e591aedc1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de', 'volume_size': 1} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-357637900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5452ea7f-2372-47a0-9e8b-4e591aedc1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100ea3ba4d63411985b20e65ececac71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:11Z,use_quota=True,user_id='1e451778c8e0443698bc6815f731abeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Creating volume 5452ea7f-2372-47a0-9e8b-4e591aedc1de {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:36:11 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:36:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:11 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de 1073741824 Nov 06 19:36:11 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:12 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de 1073741824" returned: 0 in 1.066s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:12 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de Nov 06 19:36:12 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:13 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de" returned: 0 in 0.737s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:36:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103e43e4-ce23-4279-8ca5-72557c8bb4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1916b55b-fda9-41f5-ab56-5f0941e4b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:13 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Volume volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de (5452ea7f-2372-47a0-9e8b-4e591aedc1de): created successfully Nov 06 19:36:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1916b55b-fda9-41f5-ab56-5f0941e4b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Flow 'volume_create_manager' (97945c35-8986-4e0d-9bbd-37623125ea17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:13 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-5e3accdf-281e-4258-aa63-b84f2bf186d0 tempest-ServerRescueNegativeTestJSON-1675007117 None] Created volume successfully. Nov 06 19:36:23 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:36:23 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:36:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Acquiring lock "cinder-5452ea7f-2372-47a0-9e8b-4e591aedc1de-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:36:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "cinder-5452ea7f-2372-47a0-9e8b-4e591aedc1de-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:36:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Acquiring lock "cinder-quobyte-5452ea7f-2372-47a0-9e8b-4e591aedc1de" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:36:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "cinder-quobyte-5452ea7f-2372-47a0-9e8b-4e591aedc1de" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:36:24 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b4bce-401b-42bf-925c-56b700e64dbb]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:36:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:24 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de Nov 06 19:36:24 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:24 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de" returned: 0 in 0.555s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:24 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de Nov 06 19:36:24 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:25 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5452ea7f-2372-47a0-9e8b-4e591aedc1de" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "cinder-quobyte-5452ea7f-2372-47a0-9e8b-4e591aedc1de" released by "delete_volume" :: held 0.950s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Created reservations ['a43d145d-364d-43bc-b73b-223848ad9e9b', 'bf11a8fb-6478-47c7-8cb5-799282118a08', '0ff84879-d0bb-4120-b7b8-a56cad5cc5fa', 'bf72f496-9d4e-4913-8aa2-f5ef1f1fde15'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:25 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:36:25 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:25 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.328s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:36:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Deleted volume successfully. Nov 06 19:36:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10cf884e-bc53-45fa-a1d5-3004518c911d tempest-ServerRescueNegativeTestJSON-1675007117 None] Lock "cinder-5452ea7f-2372-47a0-9e8b-4e591aedc1de-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-93cf1f7d-03fe-4407-8d7b-89ba403a2276 tempest-GroupsTest-545523731 None] Group tempest-Group1-1748313024: creating Nov 06 19:36:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-93cf1f7d-03fe-4407-8d7b-89ba403a2276 tempest-GroupsTest-545523731 None] Group tempest-Group1-1748313024: created successfully Nov 06 19:36:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-93cf1f7d-03fe-4407-8d7b-89ba403a2276 tempest-GroupsTest-545523731 None] Create group completed successfully. Nov 06 19:36:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-b4753a46-d493-4d50-b4ac-e135967a95df req-7d304551-b113-4c43-afe3-852e592cd9af tempest-AttachVolumeTestJSON-567700193 None] Terminate volume connection completed successfully. Nov 06 19:36:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-b4753a46-d493-4d50-b4ac-e135967a95df req-7d304551-b113-4c43-afe3-852e592cd9af tempest-AttachVolumeTestJSON-567700193 None] Deleting attachment ed3d1d5b-9323-425f-ae17-3a11e364ddea. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:36:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cfa6551d-ca20-48c9-9ef8-7ec82c9e9ab2 tempest-GroupsTest-545523731 None] Group tempest-Group2-685248981: creating Nov 06 19:36:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cfa6551d-ca20-48c9-9ef8-7ec82c9e9ab2 tempest-GroupsTest-545523731 None] Group tempest-Group2-685248981: created successfully Nov 06 19:36:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cfa6551d-ca20-48c9-9ef8-7ec82c9e9ab2 tempest-GroupsTest-545523731 None] Create group completed successfully. Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Flow 'volume_create_manager' (88b66826-f7c7-495d-9dba-6ea1c3a97a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dc98a1-dca5-434b-933d-4c915ebb41cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07dc98a1-dca5-434b-933d-4c915ebb41cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47880358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=477ccac7-4417-42d1-bef1-9191a273d0b6,host='devstack@QuobyteHD#QuobyteHD',id=3936a0be-c5cf-46c0-ad44-df34b9418ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf5fcdd6a64686ba5ec788650fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:33Z,use_quota=True,user_id='3eba060027534af8baaa6fdbe0bdf729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f9728e1-63b5-4fa5-9846-b173b1f5bdc0),volume_type_id=7f9728e1-63b5-4fa5-9846-b173b1f5bdc0)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abbff44-a875-4aab-806e-a8dff96a80ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abbff44-a875-4aab-806e-a8dff96a80ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412b4439-df40-4ff8-959d-aae3865194fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (412b4439-df40-4ff8-959d-aae3865194fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3936a0be-c5cf-46c0-ad44-df34b9418ab7', 'volume_name': 'volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1064eb03-3f6a-4d86-a3f6-677f214b23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1064eb03-3f6a-4d86-a3f6-677f214b23c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f307668-4cf1-4334-8c31-71470217967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Volume 3936a0be-c5cf-46c0-ad44-df34b9418ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7', 'volume_size': 1} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=477ccac7-4417-42d1-bef1-9191a273d0b6,created_at=2026-11-06T18:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-47880358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=477ccac7-4417-42d1-bef1-9191a273d0b6,host='devstack@QuobyteHD#QuobyteHD',id=3936a0be-c5cf-46c0-ad44-df34b9418ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf5fcdd6a64686ba5ec788650fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:33Z,use_quota=True,user_id='3eba060027534af8baaa6fdbe0bdf729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f9728e1-63b5-4fa5-9846-b173b1f5bdc0),volume_type_id=7f9728e1-63b5-4fa5-9846-b173b1f5bdc0)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Creating volume 3936a0be-c5cf-46c0-ad44-df34b9418ab7 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:36:33 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:33 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 1073741824 Nov 06 19:36:33 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:33 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 1073741824" returned: 0 in 0.598s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:33 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 Nov 06 19:36:33 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:33 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7" returned: 0 in 0.335s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:36:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f307668-4cf1-4334-8c31-71470217967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13372977-3de6-4d5e-8022-1880798844c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Volume volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 (3936a0be-c5cf-46c0-ad44-df34b9418ab7): created successfully Nov 06 19:36:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13372977-3de6-4d5e-8022-1880798844c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Flow 'volume_create_manager' (88b66826-f7c7-495d-9dba-6ea1c3a97a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:34 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-05354afc-ac89-42da-927b-8e6c46db0802 tempest-GroupsTest-545523731 None] Created volume successfully. Nov 06 19:36:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Acquiring lock "cinder-quobyte-3936a0be-c5cf-46c0-ad44-df34b9418ab7" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:36:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Lock "cinder-quobyte-3936a0be-c5cf-46c0-ad44-df34b9418ab7" acquired by "delete_volume" :: waited 0.042s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:36:36 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0813c6-d290-4cf1-8d46-21b00767edcc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:36:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:36 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 Nov 06 19:36:36 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:37 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7" returned: 0 in 0.678s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:37 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7 Nov 06 19:36:37 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:37 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3936a0be-c5cf-46c0-ad44-df34b9418ab7" returned: 0 in 0.391s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Lock "cinder-quobyte-3936a0be-c5cf-46c0-ad44-df34b9418ab7" released by "delete_volume" :: held 1.177s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:37 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Created reservations ['fbfd93b5-2088-4e79-9176-fdbfa8bb527f'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:37 devstack cinder-volume[86928]: WARNING cinder.quota [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1704701293 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1704701293, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:36:37 devstack cinder-volume[86928]: WARNING cinder.quota [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1704701293 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1704701293, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:36:37 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Created reservations ['dbc810b1-15bd-4ab8-b33f-a57c84151c02', '1e71a0a0-b0b0-499e-968f-93231c139670', '95031237-0d35-4eed-960b-d96f481dbd72', '4d21b0f3-3ab3-40a6-a1ca-afffdc644471'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:38 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:36:38 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:38 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:38 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:36:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0ec8de22-75a2-4815-89ea-8983e8c97533 tempest-GroupsTest-545523731 None] Delete group completed successfully. Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Created reservations ['cbb92e43-efcf-49f5-8b94-bbff9ccca893'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:39 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:36:39 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:39 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.301s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:39 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:36:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-034edfb7-44c2-43bd-9526-50c48aefaa87 tempest-GroupsTest-545523731 None] Delete group completed successfully. Nov 06 19:36:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-77c7bbe5-f6e0-479c-91b1-3cf2c588023c tempest-GroupsTest-545523731 None] Group tempest-GroupsTest-Group-322002833: creating Nov 06 19:36:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-77c7bbe5-f6e0-479c-91b1-3cf2c588023c tempest-GroupsTest-545523731 None] Group tempest-GroupsTest-Group-322002833: created successfully Nov 06 19:36:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-77c7bbe5-f6e0-479c-91b1-3cf2c588023c tempest-GroupsTest-545523731 None] Create group completed successfully. Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Flow 'volume_create_manager' (b1d6910f-c01e-4982-a07e-298ef815b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ff0b6-13e7-40b3-b13d-812a888d10ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ff0b6-13e7-40b3-b13d-812a888d10ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155823488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b95fa321-a1e3-4ef6-873a-80ff5a8686e6,host='devstack@QuobyteHD#QuobyteHD',id=27c3e1bb-0bf5-4580-826c-023a9ce99a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf5fcdd6a64686ba5ec788650fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:43Z,use_quota=True,user_id='3eba060027534af8baaa6fdbe0bdf729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a25140-5362-4ec1-a70e-6e4ed8853eb5),volume_type_id=56a25140-5362-4ec1-a70e-6e4ed8853eb5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcc1ac0-44f9-4e64-8deb-05f05a05d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcc1ac0-44f9-4e64-8deb-05f05a05d45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df94889-1894-4893-9ec2-dc2dbe8b2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1df94889-1894-4893-9ec2-dc2dbe8b2943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27c3e1bb-0bf5-4580-826c-023a9ce99a4c', 'volume_name': 'volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd6ac7f-03c8-4f50-a96d-450d59ca062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd6ac7f-03c8-4f50-a96d-450d59ca062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98ac5f9-30ce-4694-874a-9954a3f34705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:42 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Volume 27c3e1bb-0bf5-4580-826c-023a9ce99a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c', 'volume_size': 1} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b95fa321-a1e3-4ef6-873a-80ff5a8686e6,created_at=2026-11-06T18:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155823488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b95fa321-a1e3-4ef6-873a-80ff5a8686e6,host='devstack@QuobyteHD#QuobyteHD',id=27c3e1bb-0bf5-4580-826c-023a9ce99a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf5fcdd6a64686ba5ec788650fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:43Z,use_quota=True,user_id='3eba060027534af8baaa6fdbe0bdf729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a25140-5362-4ec1-a70e-6e4ed8853eb5),volume_type_id=56a25140-5362-4ec1-a70e-6e4ed8853eb5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Creating volume 27c3e1bb-0bf5-4580-826c-023a9ce99a4c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:36:42 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:36:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:42 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c 1073741824 Nov 06 19:36:42 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:43 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c 1073741824" returned: 0 in 0.489s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:43 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c Nov 06 19:36:43 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:43 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c" returned: 0 in 0.255s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98ac5f9-30ce-4694-874a-9954a3f34705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933e42f3-7155-4351-90d9-97a7e10e881f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:43 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Volume volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c (27c3e1bb-0bf5-4580-826c-023a9ce99a4c): created successfully Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933e42f3-7155-4351-90d9-97a7e10e881f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Flow 'volume_create_manager' (b1d6910f-c01e-4982-a07e-298ef815b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-306b1386-ea7e-4145-94cb-c23c0b997715 tempest-GroupsTest-545523731 None] Created volume successfully. Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Flow 'volume_create_manager' (8da83674-940b-45b6-9f91-039e7c2f80d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddd9b40-8f88-47e7-ad49-9fd574dd9325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddd9b40-8f88-47e7-ad49-9fd574dd9325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1612446876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b95fa321-a1e3-4ef6-873a-80ff5a8686e6,host='devstack@QuobyteHD#QuobyteHD',id=447bff02-680e-45f9-972c-9a942e4c2852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf5fcdd6a64686ba5ec788650fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:45Z,use_quota=True,user_id='3eba060027534af8baaa6fdbe0bdf729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a25140-5362-4ec1-a70e-6e4ed8853eb5),volume_type_id=56a25140-5362-4ec1-a70e-6e4ed8853eb5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95eebcd-3495-4833-814d-77d0260e8b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95eebcd-3495-4833-814d-77d0260e8b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67506976-68e1-431b-8f0e-f7952e4f0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67506976-68e1-431b-8f0e-f7952e4f0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '447bff02-680e-45f9-972c-9a942e4c2852', 'volume_name': 'volume-447bff02-680e-45f9-972c-9a942e4c2852', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e07e541-cd17-4252-9c9f-f035b223b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e07e541-cd17-4252-9c9f-f035b223b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f0b1bc-7a4e-42f1-87ae-4eb91817f7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:44 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Volume 447bff02-680e-45f9-972c-9a942e4c2852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-447bff02-680e-45f9-972c-9a942e4c2852', 'volume_size': 1} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b95fa321-a1e3-4ef6-873a-80ff5a8686e6,created_at=2026-11-06T18:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1612446876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b95fa321-a1e3-4ef6-873a-80ff5a8686e6,host='devstack@QuobyteHD#QuobyteHD',id=447bff02-680e-45f9-972c-9a942e4c2852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf5fcdd6a64686ba5ec788650fafec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:36:45Z,use_quota=True,user_id='3eba060027534af8baaa6fdbe0bdf729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a25140-5362-4ec1-a70e-6e4ed8853eb5),volume_type_id=56a25140-5362-4ec1-a70e-6e4ed8853eb5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Creating volume 447bff02-680e-45f9-972c-9a942e4c2852 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:36:44 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:36:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:44 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 1073741824 Nov 06 19:36:44 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:45 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 1073741824" returned: 0 in 0.460s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:45 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 Nov 06 19:36:45 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:45 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f0b1bc-7a4e-42f1-87ae-4eb91817f7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447bff02-680e-45f9-972c-9a942e4c2852', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc08e6c8-7aef-4857-b661-c7f396b6ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:36:45 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Volume volume-447bff02-680e-45f9-972c-9a942e4c2852 (447bff02-680e-45f9-972c-9a942e4c2852): created successfully Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc08e6c8-7aef-4857-b661-c7f396b6ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:36:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Flow 'volume_create_manager' (8da83674-940b-45b6-9f91-039e7c2f80d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:36:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e6b950ce-0d75-42b5-b3be-1d179f99b06e tempest-GroupsTest-545523731 None] Created volume successfully. Nov 06 19:36:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-df711970-84c3-4e79-a60f-b9c042010549 tempest-GroupsTest-545523731 None] Update group completed successfully. Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:47 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:36:47 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a7354cc4-b134-4998-9be0-513a06564de2 tempest-GroupsTest-545523731 None] Update group completed successfully. Nov 06 19:36:47 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.342s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Acquiring lock "cinder-quobyte-27c3e1bb-0bf5-4580-826c-023a9ce99a4c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Lock "cinder-quobyte-27c3e1bb-0bf5-4580-826c-023a9ce99a4c" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a073729-d0c5-47e8-a6f7-953daae3aaf0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:49 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c Nov 06 19:36:49 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:49 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:49 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c Nov 06 19:36:49 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:49 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-27c3e1bb-0bf5-4580-826c-023a9ce99a4c" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Lock "cinder-quobyte-27c3e1bb-0bf5-4580-826c-023a9ce99a4c" released by "delete_volume" :: held 0.783s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Acquiring lock "cinder-quobyte-447bff02-680e-45f9-972c-9a942e4c2852" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Lock "cinder-quobyte-447bff02-680e-45f9-972c-9a942e4c2852" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a3f52-c15f-4d52-858c-d940cce84d19]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:36:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:50 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 Nov 06 19:36:50 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:50 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852" returned: 0 in 0.434s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:50 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852 Nov 06 19:36:50 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:50 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-447bff02-680e-45f9-972c-9a942e4c2852" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Lock "cinder-quobyte-447bff02-680e-45f9-972c-9a942e4c2852" released by "delete_volume" :: held 0.748s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Created reservations ['eef4f6ee-97eb-4567-8208-02d11263a0e3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:50 devstack cinder-volume[86928]: WARNING cinder.quota [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1396454214 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1396454214, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:36:50 devstack cinder-volume[86928]: WARNING cinder.quota [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1396454214 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1396454214, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Created reservations ['4747d12c-ae73-444d-87cc-65872571b303', '398463b4-be72-4bc1-80d6-c618a6eea46a', '19af72aa-59d1-4b18-8565-8876e67644bd', 'a0e90d96-00d0-422f-9fb1-e5485626a3a8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Created reservations ['23e76d92-1cde-435f-b077-415f55ca4dd5', 'c302caa1-268a-41c2-ad6e-0af83ef143dd', 'ebecac63-6bbe-4e47-a88f-fb69c8bc6dcc', '5132acc6-9123-4aeb-9b2c-b93d202cc83b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:36:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:36:51 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:36:51 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:36:51 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Nov 06 19:36:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.252s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:36:51 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:36:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9df92ab4-1cbf-408e-9073-6c99753e5613 tempest-GroupsTest-545523731 None] Delete group completed successfully. Nov 06 19:36:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-00969e26-68ac-4f16-82ae-d5b2857e6eaf req-151a8081-1768-4b7c-ba2c-5ba314450bd6 tempest-ServerActionsTestOtherA-1075691181 None] Terminate volume connection completed successfully. Nov 06 19:36:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-00969e26-68ac-4f16-82ae-d5b2857e6eaf req-151a8081-1768-4b7c-ba2c-5ba314450bd6 tempest-ServerActionsTestOtherA-1075691181 None] Deleting attachment e8897bec-fcc3-4699-887d-cb558f451109. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:37:03 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=55,cinder:UPDATE=44,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:37:03 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=42,cinder:INSERT=9,cinder:UPDATE=64,cinder:DELETE=3 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Flow 'volume_create_manager' (8713f0cf-2ef1-4446-a035-0b19f9d977fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58aee572-c0b5-41c4-8400-34bf09114d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58aee572-c0b5-41c4-8400-34bf09114d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-252206439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf8432-2d6a-4f45-809d-0ec6a26c167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b63e3e08b048f5b6ff27b95f76f36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:04Z,use_quota=True,user_id='71993c84c6b84fbc977547f6d7451b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a5962c-73ee-4cb4-a07f-3b2b9d3ee4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a5962c-73ee-4cb4-a07f-3b2b9d3ee4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0add04e2-e550-4412-8858-e7de2ac252ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:04 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0add04e2-e550-4412-8858-e7de2ac252ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0eaf8432-2d6a-4f45-809d-0ec6a26c167f', 'volume_name': 'volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8056a46-ca5a-4bf3-b2ce-30d6c1181ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8056a46-ca5a-4bf3-b2ce-30d6c1181ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3150011-0584-4d74-b05b-05433bac7b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Volume 0eaf8432-2d6a-4f45-809d-0ec6a26c167f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Trying to clone 0eaf8432-2d6a-4f45-809d-0ec6a26c167f from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:37:05 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Image download 20.69 MB at 20.69 MB/s Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9921a8-3393-46f4-be12-418333f5f6b9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:05 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD Nov 06 19:37:05 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:06 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD" returned: 0 in 0.642s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:06 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 is fetched for user 71993c84c6b84fbc977547f6d7451b73. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:37:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e666e08-0f5f-4a45-9d8b-54023bce08d3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:06 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD Nov 06 19:37:06 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:07 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-252206439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf8432-2d6a-4f45-809d-0ec6a26c167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b63e3e08b048f5b6ff27b95f76f36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:04Z,use_quota=True,user_id='71993c84c6b84fbc977547f6d7451b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Creating volume 0eaf8432-2d6a-4f45-809d-0ec6a26c167f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:37:07 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:37:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:07 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f 1073741824 Nov 06 19:37:07 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:07 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f 1073741824" returned: 0 in 0.817s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:08 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f Nov 06 19:37:08 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:08 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f" returned: 0 in 0.346s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Attempting download of 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume 0eaf8432-2d6a-4f45-809d-0ec6a26c167f. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[448b8f57-2180-47b9-9b34-485397f5f070]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_qbc35ljw {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:08 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_qbc35ljw Nov 06 19:37:08 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:09 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_qbc35ljw" returned: 0 in 0.520s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_qbc35ljw {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:09 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_qbc35ljw Nov 06 19:37:09 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:09 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_qbc35ljw" returned: 1 in 0.484s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_qbc35ljw' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:37:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4f63b9-d258-4cd8-a8e1-df345214c000]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:09 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD Nov 06 19:37:09 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:10 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD" returned: 0 in 0.681s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:10 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] 1ceb92fc-a0e0-406c-96f4-c36f37d42275 was qcow2, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:37:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:10 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f Nov 06 19:37:10 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:13 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f" returned: 0 in 3.359s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:13 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_d_cz4f2gdevstack@QuobyteHD, size 112.00 MB, duration 3.36 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:37:13 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Converted 112.00 MB image at 33.33 MB/s Nov 06 19:37:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:13 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f 1G Nov 06 19:37:13 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:14 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f 1G" returned: 0 in 0.735s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Downloaded image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume 0eaf8432-2d6a-4f45-809d-0ec6a26c167f successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 for user 71993c84c6b84fbc977547f6d7451b73 is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Marking volume 0eaf8432-2d6a-4f45-809d-0ec6a26c167f as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Copying metadata from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 to 0eaf8432-2d6a-4f45-809d-0ec6a26c167f. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Creating volume glance metadata for volume 0eaf8432-2d6a-4f45-809d-0ec6a26c167f backed by image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3150011-0584-4d74-b05b-05433bac7b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b37e6d4-b4e8-4e07-b2b4-d5d9a780934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:14 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Volume volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f (0eaf8432-2d6a-4f45-809d-0ec6a26c167f): created successfully Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b37e6d4-b4e8-4e07-b2b4-d5d9a780934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Flow 'volume_create_manager' (8713f0cf-2ef1-4446-a035-0b19f9d977fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-493d3a83-f94b-4224-b866-4e4544e63b5d tempest-ServerActionsTestOtherA-1075691181 None] Created volume successfully. Nov 06 19:37:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-74177ad9-da03-442e-b78b-9b329cd353b4 req-9eb89fa4-a328-4ff3-bfcd-c96596327cf4 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-74177ad9-da03-442e-b78b-9b329cd353b4 req-9eb89fa4-a328-4ff3-bfcd-c96596327cf4 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-74177ad9-da03-442e-b78b-9b329cd353b4 req-9eb89fa4-a328-4ff3-bfcd-c96596327cf4 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-74177ad9-da03-442e-b78b-9b329cd353b4 req-9eb89fa4-a328-4ff3-bfcd-c96596327cf4 tempest-ServerActionsTestOtherA-1075691181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55fbb2af-96bb-4ac3-a464-0e3f94447c21', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:37:23 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-74177ad9-da03-442e-b78b-9b329cd353b4 req-9eb89fa4-a328-4ff3-bfcd-c96596327cf4 tempest-ServerActionsTestOtherA-1075691181 None] attachment_update completed successfully. Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Flow 'volume_create_manager' (6e2c253a-58a3-465d-b952-09c8e3a8a1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c55eac-e2fb-4e2f-a7d3-9b356361c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c55eac-e2fb-4e2f-a7d3-9b356361c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1150653112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e119c60e-3f5c-47e0-8ea3-087ca4e65e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dad784721d4aa58483658a43f4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:29Z,use_quota=True,user_id='d0e4224645fe48aebe698bce7bf24bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4774e71-9f52-4648-9005-76a077c1b936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4774e71-9f52-4648-9005-76a077c1b936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15e1115-0853-4c6c-a039-f9a3a3c6b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15e1115-0853-4c6c-a039-f9a3a3c6b973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e119c60e-3f5c-47e0-8ea3-087ca4e65e6a', 'volume_name': 'volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21491a14-642e-4be0-85d0-ccb10b4e9439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21491a14-642e-4be0-85d0-ccb10b4e9439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4885a202-785d-4c2e-b6a5-38886f4d144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:28 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Volume e119c60e-3f5c-47e0-8ea3-087ca4e65e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a', 'volume_size': 1} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1150653112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e119c60e-3f5c-47e0-8ea3-087ca4e65e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dad784721d4aa58483658a43f4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:29Z,use_quota=True,user_id='d0e4224645fe48aebe698bce7bf24bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Creating volume e119c60e-3f5c-47e0-8ea3-087ca4e65e6a {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:37:28 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:37:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:28 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a 1073741824 Nov 06 19:37:28 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:30 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a 1073741824" returned: 0 in 1.262s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:30 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a Nov 06 19:37:30 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:30 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a" returned: 0 in 0.531s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4885a202-785d-4c2e-b6a5-38886f4d144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d94070-3af9-4325-94fd-f5ad143d1f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Volume volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a (e119c60e-3f5c-47e0-8ea3-087ca4e65e6a): created successfully Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d94070-3af9-4325-94fd-f5ad143d1f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Flow 'volume_create_manager' (6e2c253a-58a3-465d-b952-09c8e3a8a1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c859211e-5977-48e1-a864-b3f52c82f54a tempest-ServersNegativeTestJSON-1338561930 None] Created volume successfully. Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Flow 'volume_create_manager' (4cc3b957-a7d7-4e7d-b321-f8ba03e1efcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f6a2d7-c671-49b0-bf09-dbdeb57cb439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f6a2d7-c671-49b0-bf09-dbdeb57cb439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1418275531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cf6d67-ecc7-4852-bcb9-4b026f78f998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7781f48f1cd41c19e678dbb4e29012d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:32Z,use_quota=True,user_id='ad11335ddc614c5eb8901cc6530788f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f369e31-bbe1-4ab7-93e4-1a389bde6458),volume_type_id=1f369e31-bbe1-4ab7-93e4-1a389bde6458)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404e1a10-8382-4bf7-8355-4ef4e0797564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404e1a10-8382-4bf7-8355-4ef4e0797564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a84c3bc-d2bc-4f6c-8b35-165c99f41966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a84c3bc-d2bc-4f6c-8b35-165c99f41966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cf6d67-ecc7-4852-bcb9-4b026f78f998', 'volume_name': 'volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb0b291-2e1e-4b6b-a2da-c9dd78c81773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb0b291-2e1e-4b6b-a2da-c9dd78c81773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a81124-0547-4afc-9d62-c169b5904cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Volume 95cf6d67-ecc7-4852-bcb9-4b026f78f998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998', 'volume_size': 1} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1418275531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cf6d67-ecc7-4852-bcb9-4b026f78f998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7781f48f1cd41c19e678dbb4e29012d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:32Z,use_quota=True,user_id='ad11335ddc614c5eb8901cc6530788f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f369e31-bbe1-4ab7-93e4-1a389bde6458),volume_type_id=1f369e31-bbe1-4ab7-93e4-1a389bde6458)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Creating volume 95cf6d67-ecc7-4852-bcb9-4b026f78f998 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:37:32 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:37:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:32 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 1073741824 Nov 06 19:37:32 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:33 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 1073741824" returned: 0 in 1.027s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:33 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 Nov 06 19:37:33 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Flow 'volume_create_manager' (09227c6c-572b-4b5c-ab94-8846d0d903b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f23235-0a19-4c92-bb54-1fac3bf38ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f23235-0a19-4c92-bb54-1fac3bf38ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-396152474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f19c671-d660-4cb3-b924-13166b57a8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dad784721d4aa58483658a43f4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:34Z,use_quota=True,user_id='d0e4224645fe48aebe698bce7bf24bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f6eda-f97c-4cde-bae9-723ca6c45399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f6eda-f97c-4cde-bae9-723ca6c45399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df598b94-2e20-4e98-9ef0-cbc901144e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df598b94-2e20-4e98-9ef0-cbc901144e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f19c671-d660-4cb3-b924-13166b57a8ad', 'volume_name': 'volume-9f19c671-d660-4cb3-b924-13166b57a8ad', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed93ad9-b22c-4e45-8381-37038f67f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed93ad9-b22c-4e45-8381-37038f67f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b12e26-dc88-47ee-bce9-54eaa9be056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Volume 9f19c671-d660-4cb3-b924-13166b57a8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f19c671-d660-4cb3-b924-13166b57a8ad', 'volume_size': 1} Nov 06 19:37:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:34 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998" returned: 0 in 0.493s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-396152474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f19c671-d660-4cb3-b924-13166b57a8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02dad784721d4aa58483658a43f4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:34Z,use_quota=True,user_id='d0e4224645fe48aebe698bce7bf24bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Creating volume 9f19c671-d660-4cb3-b924-13166b57a8ad {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:37:34 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a81124-0547-4afc-9d62-c169b5904cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf1c3c7-d30e-46b6-9246-e50a161b6afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Volume volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 (95cf6d67-ecc7-4852-bcb9-4b026f78f998): created successfully Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf1c3c7-d30e-46b6-9246-e50a161b6afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:34 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad 1073741824 Nov 06 19:37:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Flow 'volume_create_manager' (4cc3b957-a7d7-4e7d-b321-f8ba03e1efcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:34 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:34 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cb2c504a-562e-4b56-b3ed-a0803aa85920 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Created volume successfully. Nov 06 19:37:35 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad 1073741824" returned: 0 in 1.148s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:35 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad Nov 06 19:37:35 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:35 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad" returned: 0 in 0.413s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:35 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b12e26-dc88-47ee-bce9-54eaa9be056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f19c671-d660-4cb3-b924-13166b57a8ad', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:35 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa278b2b-a7b2-4d33-9e1d-2ef4e0b45695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Volume volume-9f19c671-d660-4cb3-b924-13166b57a8ad (9f19c671-d660-4cb3-b924-13166b57a8ad): created successfully Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa278b2b-a7b2-4d33-9e1d-2ef4e0b45695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Flow 'volume_create_manager' (09227c6c-572b-4b5c-ab94-8846d0d903b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9c957588-ecc7-414e-a44a-43fd2fc584a2 tempest-ServersNegativeTestJSON-1338561930 None] Created volume successfully. Nov 06 19:37:36 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.545s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:36 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:37:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e8699a6c-3324-4dfe-9d47-a6c15c0ae249 tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Retype volume completed successfully. Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Acquiring lock "cinder-95cf6d67-ecc7-4852-bcb9-4b026f78f998-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "cinder-95cf6d67-ecc7-4852-bcb9-4b026f78f998-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Acquiring lock "cinder-quobyte-95cf6d67-ecc7-4852-bcb9-4b026f78f998" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "cinder-quobyte-95cf6d67-ecc7-4852-bcb9-4b026f78f998" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2089604f-5839-4974-a485-5b209377f110]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:37 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 Nov 06 19:37:37 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "cinder-9f19c671-d660-4cb3-b924-13166b57a8ad-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-9f19c671-d660-4cb3-b924-13166b57a8ad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "cinder-quobyte-9f19c671-d660-4cb3-b924-13166b57a8ad" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-quobyte-9f19c671-d660-4cb3-b924-13166b57a8ad" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3718d217-b5a2-49be-b8a2-533479964303]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:38 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998" returned: 0 in 0.710s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:38 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998 Nov 06 19:37:38 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:38 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad Nov 06 19:37:38 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:38 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95cf6d67-ecc7-4852-bcb9-4b026f78f998" returned: 0 in 0.532s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "cinder-quobyte-95cf6d67-ecc7-4852-bcb9-4b026f78f998" released by "delete_volume" :: held 1.326s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:38 devstack cinder-volume[86928]: WARNING cinder.quota [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:37:38 devstack cinder-volume[86928]: WARNING cinder.quota [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Created reservations ['19117e2d-1bb2-402b-af5c-3357cd7226ce', '4708b417-b0cd-4caf-931b-9e49f2c6f035', '15ec48ab-cd23-4fc6-b52f-a8ccf3e85e2d', '5148fd04-711c-4818-bd92-cc4f1a727aa2'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:38 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad" returned: 0 in 0.954s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:39 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:37:39 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:39 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad Nov 06 19:37:39 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:39 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:37:39 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Deleted volume successfully. Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9f19c671-d660-4cb3-b924-13166b57a8ad" returned: 0 in 0.548s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-quobyte-9f19c671-d660-4cb3-b924-13166b57a8ad" released by "delete_volume" :: held 1.562s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c0547666-e80c-4301-8bd3-a825f279b88b tempest-VolumeRetypeWithoutMigrationTest-988133242 None] Lock "cinder-95cf6d67-ecc7-4852-bcb9-4b026f78f998-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Created reservations ['e86d3302-01a1-4833-a17a-192af17ad074', '19aa101c-bec9-4011-8afa-57e109c79775', 'd1968a9c-ac7a-4f3f-9905-3fc76259f34a', '0417e700-c51b-467f-8ee8-5217dcb60a7f'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:39 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:37:39 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:40 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:37:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Deleted volume successfully. Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c5c5326-6153-4bd1-8c16-fd2bc4f6e840 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-9f19c671-d660-4cb3-b924-13166b57a8ad-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "cinder-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "cinder-quobyte-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-quobyte-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4579c92-6154-4404-bc20-72ba76af9262]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:40 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a Nov 06 19:37:40 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:41 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a" returned: 0 in 0.919s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:41 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a Nov 06 19:37:41 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:41 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a" returned: 0 in 0.461s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-quobyte-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a" released by "delete_volume" :: held 1.462s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:41 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Created reservations ['f0c98919-6c2e-45a4-9901-94b54ea460f8', 'a7835ac7-4575-43bd-b228-4d4c388347f0', '426286c2-30fb-4001-a194-243fffbc88e2', '630e68d0-6660-4eb1-9094-5e2474acef83'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:42 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:37:42 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:42 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.530s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:37:42 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Deleted volume successfully. Nov 06 19:37:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c01ca3ea-5168-435c-8385-943bb22f2591 tempest-ServersNegativeTestJSON-1338561930 None] Lock "cinder-e119c60e-3f5c-47e0-8ea3-087ca4e65e6a-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-503dc02c-7396-420a-9c80-6646c5d7051e req-391a5b6d-0374-42cd-a99e-6868f1e7c2ed tempest-ServerActionsTestOtherA-1075691181 None] Terminate volume connection completed successfully. Nov 06 19:37:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-503dc02c-7396-420a-9c80-6646c5d7051e req-391a5b6d-0374-42cd-a99e-6868f1e7c2ed tempest-ServerActionsTestOtherA-1075691181 None] Deleting attachment 55fbb2af-96bb-4ac3-a464-0e3f94447c21. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:37:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-503dc02c-7396-420a-9c80-6646c5d7051e req-66d1c7c8-652b-4776-8fef-3102be39413c tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-503dc02c-7396-420a-9c80-6646c5d7051e req-66d1c7c8-652b-4776-8fef-3102be39413c tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-503dc02c-7396-420a-9c80-6646c5d7051e req-66d1c7c8-652b-4776-8fef-3102be39413c tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-503dc02c-7396-420a-9c80-6646c5d7051e req-66d1c7c8-652b-4776-8fef-3102be39413c tempest-ServerActionsTestOtherA-1075691181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7d002e2-9e8e-47e6-9929-a095a4264bb5', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:37:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-503dc02c-7396-420a-9c80-6646c5d7051e req-66d1c7c8-652b-4776-8fef-3102be39413c tempest-ServerActionsTestOtherA-1075691181 None] attachment_update completed successfully. Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:47 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:37:47 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:47 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:37:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Flow 'volume_create_manager' (84d7cc29-ec8c-4518-928b-04727c691b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dcda51-9d4c-48b1-bf17-02f52d1247ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dcda51-9d4c-48b1-bf17-02f52d1247ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1164108571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb300ba-54e3-404f-affc-88d9455fb960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf3b219eec4d72b5c4fb7a3a4ea973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:48Z,use_quota=True,user_id='e751589471aa4ab48a4a329183c43e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67710088-5136-4764-9902-fb6abc64b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67710088-5136-4764-9902-fb6abc64b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea35b1d8-56de-4f4a-a229-09b8ec7f6bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea35b1d8-56de-4f4a-a229-09b8ec7f6bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb300ba-54e3-404f-affc-88d9455fb960', 'volume_name': 'volume-8cb300ba-54e3-404f-affc-88d9455fb960', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4e4002-e460-4e1d-807e-d25a5b069a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4e4002-e460-4e1d-807e-d25a5b069a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e039d1-1015-4999-89fd-d1ff3b6086e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:48 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Volume 8cb300ba-54e3-404f-affc-88d9455fb960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb300ba-54e3-404f-affc-88d9455fb960', 'volume_size': 1} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1164108571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb300ba-54e3-404f-affc-88d9455fb960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf3b219eec4d72b5c4fb7a3a4ea973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:48Z,use_quota=True,user_id='e751589471aa4ab48a4a329183c43e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Creating volume 8cb300ba-54e3-404f-affc-88d9455fb960 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:37:48 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:37:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:48 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 1073741824 Nov 06 19:37:48 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:49 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 1073741824" returned: 0 in 0.715s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:49 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 Nov 06 19:37:49 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:49 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960" returned: 0 in 0.431s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e039d1-1015-4999-89fd-d1ff3b6086e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb300ba-54e3-404f-affc-88d9455fb960', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086f1899-4bf1-4645-91af-aac1b3fde52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:49 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Volume volume-8cb300ba-54e3-404f-affc-88d9455fb960 (8cb300ba-54e3-404f-affc-88d9455fb960): created successfully Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086f1899-4bf1-4645-91af-aac1b3fde52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Flow 'volume_create_manager' (84d7cc29-ec8c-4518-928b-04727c691b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c7f98f94-c7c1-41a7-9805-75d623b43e68 tempest-AttachVolumeTestJSON-567700193 None] Created volume successfully. Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Flow 'volume_create_manager' (7fa05ad0-d827-4460-8ffa-2d6be9b055b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22515aaa-f761-429b-8948-8e23e6c07b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22515aaa-f761-429b-8948-8e23e6c07b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1315592850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a26627-c1cf-4d8c-ad77-51db803bcbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a2dde840f4448f9db2ffd08fcebeff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:51Z,use_quota=True,user_id='a7a3824f661a4861b081160ca9c866d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e02751f-5890-458f-858e-48fb204a5a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e02751f-5890-458f-858e-48fb204a5a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb4ec38-ad0a-4ecb-816c-8cb3a7e0f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb4ec38-ad0a-4ecb-816c-8cb3a7e0f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a26627-c1cf-4d8c-ad77-51db803bcbfd', 'volume_name': 'volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58889565-bf2a-433e-a563-e100839a3ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58889565-bf2a-433e-a563-e100839a3ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4243c12a-86c7-42f0-baf9-15e9284a852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Volume 02a26627-c1cf-4d8c-ad77-51db803bcbfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd', 'volume_size': 1} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1315592850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a26627-c1cf-4d8c-ad77-51db803bcbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a2dde840f4448f9db2ffd08fcebeff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:51Z,use_quota=True,user_id='a7a3824f661a4861b081160ca9c866d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Creating volume 02a26627-c1cf-4d8c-ad77-51db803bcbfd {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:37:50 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:37:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:51 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd 1073741824 Nov 06 19:37:51 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:51 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd 1073741824" returned: 0 in 0.706s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:51 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd Nov 06 19:37:51 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3c899d82-2329-4df8-952a-dbda7fa22551 req-30c30c98-6b13-4e92-a7c0-eedc5c476816 tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:52 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd" returned: 0 in 0.460s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3c899d82-2329-4df8-952a-dbda7fa22551 req-30c30c98-6b13-4e92-a7c0-eedc5c476816 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.051s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4243c12a-86c7-42f0-baf9-15e9284a852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e8eaaa-8a19-425b-9abc-d97ce7430267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3c899d82-2329-4df8-952a-dbda7fa22551 req-30c30c98-6b13-4e92-a7c0-eedc5c476816 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Volume volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd (02a26627-c1cf-4d8c-ad77-51db803bcbfd): created successfully Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e8eaaa-8a19-425b-9abc-d97ce7430267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Flow 'volume_create_manager' (7fa05ad0-d827-4460-8ffa-2d6be9b055b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e1c478ca-5fb1-4bf4-9c55-62877cb60e95 tempest-VolumesServicesTestJSON-457366881 None] Created volume successfully. Nov 06 19:37:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-3c899d82-2329-4df8-952a-dbda7fa22551 req-30c30c98-6b13-4e92-a7c0-eedc5c476816 tempest-AttachVolumeTestJSON-567700193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-8cb300ba-54e3-404f-affc-88d9455fb960', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ea636b6-518d-4ebf-8d86-0187e65ce7cc', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:37:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-3c899d82-2329-4df8-952a-dbda7fa22551 req-30c30c98-6b13-4e92-a7c0-eedc5c476816 tempest-AttachVolumeTestJSON-567700193 None] attachment_update completed successfully. Nov 06 19:37:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Acquiring lock "cinder-02a26627-c1cf-4d8c-ad77-51db803bcbfd-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Lock "cinder-02a26627-c1cf-4d8c-ad77-51db803bcbfd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Acquiring lock "cinder-quobyte-02a26627-c1cf-4d8c-ad77-51db803bcbfd" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:37:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Lock "cinder-quobyte-02a26627-c1cf-4d8c-ad77-51db803bcbfd" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:37:53 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bee9d1-1d28-4963-8ae6-3ee87a070ed5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:37:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:53 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd Nov 06 19:37:53 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:54 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd" returned: 0 in 0.966s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:54 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd Nov 06 19:37:54 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:55 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-02a26627-c1cf-4d8c-ad77-51db803bcbfd" returned: 0 in 0.541s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Lock "cinder-quobyte-02a26627-c1cf-4d8c-ad77-51db803bcbfd" released by "delete_volume" :: held 1.599s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Created reservations ['b334dd12-320e-4b79-b660-75ac8a492af0', 'f99dac26-822a-4a5b-ac1e-80b268df2b2e', '41d00e67-613c-4a1e-92c3-9a04d33f24d6', 'a9aeaee7-bc83-4cac-8515-fda14debc512'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Flow 'volume_create_manager' (ff490a41-aa3e-402b-abe8-0fe31cb6ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa59b24-b49c-48c6-89ec-a72914498fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa59b24-b49c-48c6-89ec-a72914498fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1011614236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2ab6e0-72da-4b79-940f-5defd43e6134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf3b219eec4d72b5c4fb7a3a4ea973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:55Z,use_quota=True,user_id='e751589471aa4ab48a4a329183c43e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2e461a-3b03-440c-950d-49de7ce99de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2e461a-3b03-440c-950d-49de7ce99de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05162eac-0e5a-4694-b3c6-a143dff85d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05162eac-0e5a-4694-b3c6-a143dff85d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2ab6e0-72da-4b79-940f-5defd43e6134', 'volume_name': 'volume-6a2ab6e0-72da-4b79-940f-5defd43e6134', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27e961c-3638-4c47-8c8a-7f808aec4a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27e961c-3638-4c47-8c8a-7f808aec4a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a122ec0-d71a-4d92-8b0c-1ad9d52fef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:55 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Volume 6a2ab6e0-72da-4b79-940f-5defd43e6134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2ab6e0-72da-4b79-940f-5defd43e6134', 'volume_size': 1} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1011614236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2ab6e0-72da-4b79-940f-5defd43e6134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddf3b219eec4d72b5c4fb7a3a4ea973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:37:55Z,use_quota=True,user_id='e751589471aa4ab48a4a329183c43e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Creating volume 6a2ab6e0-72da-4b79-940f-5defd43e6134 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:37:55 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:55 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 1073741824 Nov 06 19:37:55 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:55 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:37:55 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:56 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.617s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:37:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Deleted volume successfully. Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8d2ccb98-63ff-4f13-8e78-bd733c850e6a tempest-VolumesServicesTestJSON-457366881 None] Lock "cinder-02a26627-c1cf-4d8c-ad77-51db803bcbfd-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:37:56 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 1073741824" returned: 0 in 0.851s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:37:56 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 Nov 06 19:37:56 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:37:56 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134" returned: 0 in 0.425s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a122ec0-d71a-4d92-8b0c-1ad9d52fef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2ab6e0-72da-4b79-940f-5defd43e6134', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf14b4d-833e-47af-a7e1-4f15314565bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:37:56 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Volume volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 (6a2ab6e0-72da-4b79-940f-5defd43e6134): created successfully Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf14b4d-833e-47af-a7e1-4f15314565bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:37:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Flow 'volume_create_manager' (ff490a41-aa3e-402b-abe8-0fe31cb6ae25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:37:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aeeea2bd-5824-4328-a1cb-19ef2ccd4c4b tempest-AttachVolumeTestJSON-567700193 None] Created volume successfully. Nov 06 19:37:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-7ec3c80e-417a-43bb-bf9c-c2e2fd0f734d req-1b1a40e8-0d6e-492e-af6e-a3e342610fa8 tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:37:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-7ec3c80e-417a-43bb-bf9c-c2e2fd0f734d req-1b1a40e8-0d6e-492e-af6e-a3e342610fa8 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:37:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-7ec3c80e-417a-43bb-bf9c-c2e2fd0f734d req-1b1a40e8-0d6e-492e-af6e-a3e342610fa8 tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:37:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-7ec3c80e-417a-43bb-bf9c-c2e2fd0f734d req-1b1a40e8-0d6e-492e-af6e-a3e342610fa8 tempest-AttachVolumeTestJSON-567700193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-6a2ab6e0-72da-4b79-940f-5defd43e6134', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6934a000-71d7-4e03-8cf2-7057c419220a', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:37:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-7ec3c80e-417a-43bb-bf9c-c2e2fd0f734d req-1b1a40e8-0d6e-492e-af6e-a3e342610fa8 tempest-AttachVolumeTestJSON-567700193 None] attachment_update completed successfully. Nov 06 19:38:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-56b512a5-2dd2-44c9-b158-34901d8feb96 req-09fc6be9-5605-43a2-b4e2-757e5dc5fd18 tempest-AttachVolumeTestJSON-567700193 None] Terminate volume connection completed successfully. Nov 06 19:38:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-56b512a5-2dd2-44c9-b158-34901d8feb96 req-09fc6be9-5605-43a2-b4e2-757e5dc5fd18 tempest-AttachVolumeTestJSON-567700193 None] Deleting attachment 3ea636b6-518d-4ebf-8d86-0187e65ce7cc. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:38:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-9be8f51d-5419-4804-a2ca-013d6e58379a req-043db4fe-7054-4d4d-9c18-e592fcb50e7f tempest-AttachVolumeTestJSON-567700193 None] Terminate volume connection completed successfully. Nov 06 19:38:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-9be8f51d-5419-4804-a2ca-013d6e58379a req-043db4fe-7054-4d4d-9c18-e592fcb50e7f tempest-AttachVolumeTestJSON-567700193 None] Deleting attachment 6934a000-71d7-4e03-8cf2-7057c419220a. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "cinder-6a2ab6e0-72da-4b79-940f-5defd43e6134-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-6a2ab6e0-72da-4b79-940f-5defd43e6134-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=81,cinder:INSERT=17,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=67,cinder:SELECT=75,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "cinder-quobyte-6a2ab6e0-72da-4b79-940f-5defd43e6134" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-quobyte-6a2ab6e0-72da-4b79-940f-5defd43e6134" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea15cf-41b6-4153-9ed7-2d9558cd4505]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:12 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 Nov 06 19:38:12 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:13 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134" returned: 0 in 0.455s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:13 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134 Nov 06 19:38:13 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:13 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6a2ab6e0-72da-4b79-940f-5defd43e6134" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-quobyte-6a2ab6e0-72da-4b79-940f-5defd43e6134" released by "delete_volume" :: held 0.819s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Flow 'volume_create_manager' (1961d623-266e-4d12-af65-2f07738f5f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076fc0fa-97ea-44d6-8815-5e0ef87ae28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076fc0fa-97ea-44d6-8815-5e0ef87ae28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1274236902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138c4162-33a5-41ed-b251-2ee41defa350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745d708eeff242d08ee15db27fa7fb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:13Z,use_quota=True,user_id='cf54a96bf9184f54be654726fc6a63bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e82c487-07bd-4d50-8c6e-0b98d2649fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e82c487-07bd-4d50-8c6e-0b98d2649fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238c7975-b2b5-41f3-b3b8-c6b68a74f5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238c7975-b2b5-41f3-b3b8-c6b68a74f5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138c4162-33a5-41ed-b251-2ee41defa350', 'volume_name': 'volume-138c4162-33a5-41ed-b251-2ee41defa350', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb94ded6-c30d-49da-a41a-8ed438b5e163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb94ded6-c30d-49da-a41a-8ed438b5e163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4fd8a9-19eb-4156-be51-34398d4234ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:13 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Volume 138c4162-33a5-41ed-b251-2ee41defa350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138c4162-33a5-41ed-b251-2ee41defa350', 'volume_size': 1} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1274236902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138c4162-33a5-41ed-b251-2ee41defa350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745d708eeff242d08ee15db27fa7fb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:13Z,use_quota=True,user_id='cf54a96bf9184f54be654726fc6a63bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Creating volume 138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:38:13 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:13 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 1073741824 Nov 06 19:38:13 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Created reservations ['adecd8f1-1adf-447f-8d22-b03c9f9bb196', '28a34152-5f5e-40b6-8539-ccb25f11e789', 'd7e2d02e-282e-4e8e-a9b8-61210c3c26c0', '0c321f6a-3342-4fd1-bce3-7431a01cbffd'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:13 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:13 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:14 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.334s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Deleted volume successfully. Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44ac5984-9e09-4a64-8304-f56d9434224e tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-6a2ab6e0-72da-4b79-940f-5defd43e6134-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:14 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 1073741824" returned: 0 in 0.650s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:14 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 Nov 06 19:38:14 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:14 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4fd8a9-19eb-4156-be51-34398d4234ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138c4162-33a5-41ed-b251-2ee41defa350', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55caece5-11c4-4879-a459-c5578b25c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:14 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Volume volume-138c4162-33a5-41ed-b251-2ee41defa350 (138c4162-33a5-41ed-b251-2ee41defa350): created successfully Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55caece5-11c4-4879-a459-c5578b25c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Flow 'volume_create_manager' (1961d623-266e-4d12-af65-2f07738f5f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b9684b99-1447-463b-b394-0ebeebb7362f tempest-SnapshotMetadataTestJSON-153690181 None] Created volume successfully. Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "cinder-8cb300ba-54e3-404f-affc-88d9455fb960-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-8cb300ba-54e3-404f-affc-88d9455fb960-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "cinder-quobyte-8cb300ba-54e3-404f-affc-88d9455fb960" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-quobyte-8cb300ba-54e3-404f-affc-88d9455fb960" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba62f68-4b81-4a6a-9440-f2a3fa013d6d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:15 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 Nov 06 19:38:15 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:15 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960" returned: 0 in 0.418s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:15 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960 Nov 06 19:38:15 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:15 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cb300ba-54e3-404f-affc-88d9455fb960" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-quobyte-8cb300ba-54e3-404f-affc-88d9455fb960" released by "delete_volume" :: held 0.759s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Created reservations ['f8000c61-a48c-477a-aeae-e57fc5e9a2ba', '012eb313-5e0b-4cc3-a732-a5031a4eaf0e', '757bb3c1-1083-483a-9909-d6b0c056b26c', '1b6af362-27b2-4cbb-a480-0f444412e68d'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Creating offline snapshot a118c55e-805f-47f0-83c5-8c539fdc0c9f of volume 138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2bdcf-76fd-4022-aeaa-88887c51370d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:15 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 Nov 06 19:38:15 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:16 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:16 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "cinder-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "cinder-quobyte-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-quobyte-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b96faff-28a4-4751-bf16-fb83c2148317]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:16 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.492s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:16 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Deleted volume successfully. Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9aed7fd6-46a8-4b43-a7d3-f44a090f88af tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-8cb300ba-54e3-404f-affc-88d9455fb960-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:16 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350" returned: 0 in 0.680s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:16 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f 1G Nov 06 19:38:16 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:16 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 Nov 06 19:38:16 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:16 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673" returned: 0 in 0.561s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:17 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673 Nov 06 19:38:17 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:17 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f 1G" returned: 0 in 0.563s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-138c4162-33a5-41ed-b251-2ee41defa350 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:17 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-138c4162-33a5-41ed-b251-2ee41defa350 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f Nov 06 19:38:17 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:17 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673" returned: 0 in 0.395s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-quobyte-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673" released by "delete_volume" :: held 1.082s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Created reservations ['1cdddcf4-a6a3-4100-9318-37aff20ea3ec', '36b04bba-5d7d-469b-ace3-7b16e42abe73', '94b8f4ad-a45d-40df-bf74-1506901db7ad', '74458a17-9cf9-4730-840c-465642d6934b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:17 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-138c4162-33a5-41ed-b251-2ee41defa350 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f" returned: 0 in 0.436s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:17 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f is being set with open permissions: ugo+rw Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:17 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f Nov 06 19:38:17 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:17 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:17 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:18 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f" returned: 0 in 0.670s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:18 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.651s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:18 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:18 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.info Nov 06 19:38:18 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:18 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Deleted volume successfully. Nov 06 19:38:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-378d07d8-5799-474a-9a6c-fa38b7d3e84d tempest-AttachVolumeTestJSON-567700193 None] Lock "cinder-5a7ee59b-b7ba-4e67-b5f5-7e3220c43673-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:18 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.info" returned: 0 in 0.389s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:18 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.info is being set with open permissions: ugo+rw Nov 06 19:38:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:18 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.info Nov 06 19:38:18 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:19 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.info" returned: 0 in 0.361s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.255s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:19 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8f1b0cfc-0ada-4038-aa82-8f05cc710d65 tempest-SnapshotMetadataTestJSON-153690181 None] Create snapshot completed successfully Nov 06 19:38:19 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-5bd61f35-2a81-4ea9-8617-10f6b5705b38 tempest-ServerActionsTestOtherA-1075691181 None] Terminate volume connection completed successfully. Nov 06 19:38:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-5bd61f35-2a81-4ea9-8617-10f6b5705b38 tempest-ServerActionsTestOtherA-1075691181 None] Deleting attachment a7d002e2-9e8e-47e6-9929-a095a4264bb5. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:38:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "cinder-0eaf8432-2d6a-4f45-809d-0ec6a26c167f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-0eaf8432-2d6a-4f45-809d-0ec6a26c167f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "cinder-quobyte-0eaf8432-2d6a-4f45-809d-0ec6a26c167f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-quobyte-0eaf8432-2d6a-4f45-809d-0ec6a26c167f" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:20 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3438f5d-dafb-4764-8016-d93cb5412ce8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:20 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f Nov 06 19:38:20 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:20 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f" returned: 0 in 0.702s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:20 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f Nov 06 19:38:20 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "cinder-4c992059-91b6-4cc0-9ce7-888c940e08fa-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-4c992059-91b6-4cc0-9ce7-888c940e08fa-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "cinder-quobyte-4c992059-91b6-4cc0-9ce7-888c940e08fa" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-quobyte-4c992059-91b6-4cc0-9ce7-888c940e08fa" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b5a846-56c1-464e-9d7b-aa7f1939e4c6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:21 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "cinder-a118c55e-805f-47f0-83c5-8c539fdc0c9f-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0eaf8432-2d6a-4f45-809d-0ec6a26c167f" returned: 0 in 0.531s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-quobyte-0eaf8432-2d6a-4f45-809d-0ec6a26c167f" released by "delete_volume" :: held 1.324s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-a118c55e-805f-47f0-83c5-8c539fdc0c9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:21 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa Nov 06 19:38:21 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "cinder-quobyte-138c4162-33a5-41ed-b251-2ee41defa350" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-quobyte-138c4162-33a5-41ed-b251-2ee41defa350" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "cinder-quobyte-a118c55e-805f-47f0-83c5-8c539fdc0c9f" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-quobyte-a118c55e-805f-47f0-83c5-8c539fdc0c9f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Deleting offline snapshot a118c55e-805f-47f0-83c5-8c539fdc0c9f of volume 138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] snapshot_file for this snap is: volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c1eda7-f547-4e6f-8b5e-43aa0aaf0810]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.quota [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Created reservations ['331aeb36-c505-48c7-8639-89e00ffaee25', 'f688c0a8-4852-4bf0-bc88-a8a370e7a650', 'f2895763-91c4-46df-b9ed-d1a6d87516d6', '8496e4ea-d398-4ae5-b26a-0bad4574f834'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:21 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:21 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:21 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f Nov 06 19:38:21 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:21 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa" returned: 0 in 0.485s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:21 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa Nov 06 19:38:21 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:21 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.371s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.manager [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Deleted volume successfully. Nov 06 19:38:21 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f" returned: 0 in 0.536s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-138c4162-33a5-41ed-b251-2ee41defa350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-3098574c-48fe-4a16-81a9-ed114e85d41a req-efba86f0-df29-4548-9276-0c64204c8712 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-0eaf8432-2d6a-4f45-809d-0ec6a26c167f-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4129d2-9ae7-479e-8e89-caeaf6d4612d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:22 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c992059-91b6-4cc0-9ce7-888c940e08fa" returned: 0 in 0.361s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-quobyte-4c992059-91b6-4cc0-9ce7-888c940e08fa" released by "delete_volume" :: held 0.916s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Created reservations ['0d7d212d-5802-48da-aca9-5a5281a05395', '39ca4880-7433-4a1b-891a-0cd3f1d8412d', '36477aa2-9820-4deb-b4bd-f2df61fbaa52', 'c39a1106-22c0-422c-a421-695a302e85d5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:22 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 Nov 06 19:38:22 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:22 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:22 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:22 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.326s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:22 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Deleted volume successfully. Nov 06 19:38:22 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350" returned: 0 in 0.561s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f476df1a-5206-4996-8a76-29c6a9a543c1 tempest-ServerActionsTestOtherA-1075691181 None] Lock "cinder-4c992059-91b6-4cc0-9ce7-888c940e08fa-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:22 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f Nov 06 19:38:22 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:23 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f" returned: 0 in 0.488s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:23 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f Nov 06 19:38:23 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:23 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350.a118c55e-805f-47f0-83c5-8c539fdc0c9f" returned: 0 in 0.274s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-quobyte-a118c55e-805f-47f0-83c5-8c539fdc0c9f" released by "_delete_snapshot" :: held 2.036s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-quobyte-138c4162-33a5-41ed-b251-2ee41defa350" released by "delete_snapshot" :: held 2.069s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:23 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Created reservations ['40127755-5e72-44f3-9d21-f6316034f25a', 'f9670173-bdaa-4617-9d82-d75188bc448c', 'c96f988e-a252-403d-a677-ea733a1ccf85', '5ae9005e-0b14-46af-93fd-be819cb445fb'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:23 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Delete snapshot completed successfully. Nov 06 19:38:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd1d9d4-f44f-4386-91e1-c57d77b740f2 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-a118c55e-805f-47f0-83c5-8c539fdc0c9f-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "cinder-138c4162-33a5-41ed-b251-2ee41defa350-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-138c4162-33a5-41ed-b251-2ee41defa350-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "cinder-quobyte-138c4162-33a5-41ed-b251-2ee41defa350" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-quobyte-138c4162-33a5-41ed-b251-2ee41defa350" acquired by "delete_volume" :: waited 0.048s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:25 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b3a8db-d07f-4bb4-8fb0-5675c211c8c6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:25 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 Nov 06 19:38:25 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:25 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350" returned: 0 in 0.592s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:25 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350 Nov 06 19:38:25 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:26 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-138c4162-33a5-41ed-b251-2ee41defa350" returned: 0 in 0.723s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-quobyte-138c4162-33a5-41ed-b251-2ee41defa350" released by "delete_volume" :: held 1.436s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Created reservations ['7441f7c4-686a-4e4d-bd94-fc2deef00b87', '32087f8b-7db9-46e6-b73c-211062f9f41d', 'a80ec695-5446-45da-a86b-dbbd2e42a672', '65ff35e8-09ae-4d11-99ba-d2606dc91a37'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:26 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:26 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:27 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.418s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:27 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:27 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Deleted volume successfully. Nov 06 19:38:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-76539a7d-19fe-42db-a61b-4c1657e91bd1 tempest-SnapshotMetadataTestJSON-153690181 None] Lock "cinder-138c4162-33a5-41ed-b251-2ee41defa350-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Flow 'volume_create_manager' (a1658d64-0336-4108-b608-ef975193aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5082b953-d658-408a-97e1-3eee882c45c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5082b953-d658-408a-97e1-3eee882c45c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1671412397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae0a1a0-167d-41b9-81b4-8be244a0cb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340d9d33e5904c87b8779a8edab7b6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:34Z,use_quota=True,user_id='02537e2a4e7f49818509b006c9115959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fbc059-c095-46f3-9e4c-094d6829c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fbc059-c095-46f3-9e4c-094d6829c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46d2343-72fe-4d30-8d7e-a2eda3685ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46d2343-72fe-4d30-8d7e-a2eda3685ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae0a1a0-167d-41b9-81b4-8be244a0cb52', 'volume_name': 'volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a971793-f662-49a9-832f-3f9a2ed7aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a971793-f662-49a9-832f-3f9a2ed7aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cd6544-430f-4031-ad7b-8a7bb1c08ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Volume bae0a1a0-167d-41b9-81b4-8be244a0cb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52', 'volume_size': 1} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1671412397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae0a1a0-167d-41b9-81b4-8be244a0cb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340d9d33e5904c87b8779a8edab7b6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:34Z,use_quota=True,user_id='02537e2a4e7f49818509b006c9115959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Creating volume bae0a1a0-167d-41b9-81b4-8be244a0cb52 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:38:34 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:38:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:34 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 1073741824 Nov 06 19:38:34 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:35 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 1073741824" returned: 0 in 0.562s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:35 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 Nov 06 19:38:35 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:35 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52" returned: 0 in 0.355s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cd6544-430f-4031-ad7b-8a7bb1c08ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebd25a3-d6fc-41c7-9631-8f97438bbbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Volume volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 (bae0a1a0-167d-41b9-81b4-8be244a0cb52): created successfully Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebd25a3-d6fc-41c7-9631-8f97438bbbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Flow 'volume_create_manager' (a1658d64-0336-4108-b608-ef975193aefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e46279d3-aad5-4931-bf1b-c93aa4b64af4 tempest-AbsoluteLimitsTests-2145615036 None] Created volume successfully. Nov 06 19:38:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Acquiring lock "cinder-bae0a1a0-167d-41b9-81b4-8be244a0cb52-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Lock "cinder-bae0a1a0-167d-41b9-81b4-8be244a0cb52-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Acquiring lock "cinder-quobyte-bae0a1a0-167d-41b9-81b4-8be244a0cb52" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Lock "cinder-quobyte-bae0a1a0-167d-41b9-81b4-8be244a0cb52" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:37 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d36ef1-71b9-4be1-8d2b-7aaaf9ead2f9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:37 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 Nov 06 19:38:37 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:37 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52" returned: 0 in 0.686s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:37 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52 Nov 06 19:38:37 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:38 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae0a1a0-167d-41b9-81b4-8be244a0cb52" returned: 0 in 0.551s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Lock "cinder-quobyte-bae0a1a0-167d-41b9-81b4-8be244a0cb52" released by "delete_volume" :: held 1.332s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Created reservations ['d1ff5889-31a3-476a-a659-26dadaa1f7b6', '0f9dfa9a-4d5b-49d1-94d2-1bddfbc1b7c2', '54199e19-060a-4882-b37d-c67101101258', '07afa685-3627-482d-939e-46a88b4cb740'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:38 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:38 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:39 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:39 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Deleted volume successfully. Nov 06 19:38:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e8f5b383-cada-464f-ba5f-5a3241ddfbf5 tempest-AbsoluteLimitsTests-2145615036 None] Lock "cinder-bae0a1a0-167d-41b9-81b4-8be244a0cb52-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1c974a36-8404-4562-b9df-3f31e84e7045 tempest-BackendsCapabilitiesAdminTestsJSON-1264132743 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8011436462402, 'free_capacity_gb': 1773.8011436462402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86928) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 19:38:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-62bc105f-772c-4864-bb07-ddb6d9c3784c tempest-BackendsCapabilitiesAdminTestsJSON-1264132743 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8011436462402, 'free_capacity_gb': 1773.8011436462402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86928) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Flow 'volume_create_manager' (7496d074-065e-4eb0-8f32-033a06bdbdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef45ae1a-5ec4-4eec-be9c-94b3ce6689e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef45ae1a-5ec4-4eec-be9c-94b3ce6689e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1065509445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a5323a-f041-422a-8cce-ec33b69440eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fabe5c7a35745e88cad55f266f4a62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:46Z,use_quota=True,user_id='3fb8d6fa4cb04bc8a27700773dcbc811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cf451c-e740-451f-a8ed-4946dcc085e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cf451c-e740-451f-a8ed-4946dcc085e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7136f797-1dd7-4ab5-998b-16ae6e5fd176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7136f797-1dd7-4ab5-998b-16ae6e5fd176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a5323a-f041-422a-8cce-ec33b69440eb', 'volume_name': 'volume-01a5323a-f041-422a-8cce-ec33b69440eb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011527ed-161b-468c-9c5d-3226785c4c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011527ed-161b-468c-9c5d-3226785c4c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee0800c-ec93-4ff0-9263-583b3df07ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:45 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Volume 01a5323a-f041-422a-8cce-ec33b69440eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a5323a-f041-422a-8cce-ec33b69440eb', 'volume_size': 1} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1065509445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a5323a-f041-422a-8cce-ec33b69440eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fabe5c7a35745e88cad55f266f4a62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:46Z,use_quota=True,user_id='3fb8d6fa4cb04bc8a27700773dcbc811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Creating volume 01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:38:45 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:38:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:45 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb 1073741824 Nov 06 19:38:45 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:46 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb 1073741824" returned: 0 in 0.638s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:46 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb Nov 06 19:38:46 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:46 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb" returned: 0 in 0.369s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:38:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee0800c-ec93-4ff0-9263-583b3df07ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a5323a-f041-422a-8cce-ec33b69440eb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde90663-3b1a-40b2-84bf-cad7c4c8871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:47 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Volume volume-01a5323a-f041-422a-8cce-ec33b69440eb (01a5323a-f041-422a-8cce-ec33b69440eb): created successfully Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde90663-3b1a-40b2-84bf-cad7c4c8871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Flow 'volume_create_manager' (7496d074-065e-4eb0-8f32-033a06bdbdd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c47f8096-c244-4ad8-8ae2-23097e12b581 tempest-VolumesDeleteCascade-576360817 None] Created volume successfully. Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:47 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:38:47 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:47 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.313s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:38:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:38:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Creating offline snapshot c5b4f91c-1d9f-4d22-9845-1258908514c7 of volume 01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:38:48 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[41410b86-d93d-44b5-b313-777d7702e2e2]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:48 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb Nov 06 19:38:48 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:48 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:48 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 1G Nov 06 19:38:48 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:49 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 1G" returned: 0 in 0.477s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a5323a-f041-422a-8cce-ec33b69440eb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:49 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a5323a-f041-422a-8cce-ec33b69440eb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 Nov 06 19:38:49 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:49 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a5323a-f041-422a-8cce-ec33b69440eb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7" returned: 0 in 0.426s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:49 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 is being set with open permissions: ugo+rw Nov 06 19:38:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:49 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 Nov 06 19:38:49 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:49 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7" returned: 0 in 0.353s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:50 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.info Nov 06 19:38:50 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Flow 'volume_create_manager' (4deeece1-cc01-4498-97f1-e36dfa15203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:50 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7463565-2eb5-4b16-8bb2-235bcc778298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.info" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:50 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.info is being set with open permissions: ugo+rw Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:50 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.info Nov 06 19:38:50 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7463565-2eb5-4b16-8bb2-235bcc778298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-919484198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab23e83d-ef95-4642-b40f-dde606a6887c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ab5c62d3d54dbabe34b1eccbd62bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:50Z,use_quota=True,user_id='2e35de949f6044bbbed1d1e688d56bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4414ca-d2e5-4d5b-b33c-bef9dde6decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4414ca-d2e5-4d5b-b33c-bef9dde6decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f888fe-c9d5-40a7-b393-85ba96b15cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f888fe-c9d5-40a7-b393-85ba96b15cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab23e83d-ef95-4642-b40f-dde606a6887c', 'volume_name': 'volume-ab23e83d-ef95-4642-b40f-dde606a6887c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22cec72-4ca4-4118-b98d-7b8b8a06b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22cec72-4ca4-4118-b98d-7b8b8a06b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4abd37e-2d7b-4bcc-9a3e-054140ba23c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Volume ab23e83d-ef95-4642-b40f-dde606a6887c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab23e83d-ef95-4642-b40f-dde606a6887c', 'volume_size': 1} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:50 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.info" returned: 0 in 0.284s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.236s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-919484198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab23e83d-ef95-4642-b40f-dde606a6887c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ab5c62d3d54dbabe34b1eccbd62bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:38:50Z,use_quota=True,user_id='2e35de949f6044bbbed1d1e688d56bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Creating volume ab23e83d-ef95-4642-b40f-dde606a6887c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:38:50 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:38:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:50 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c 1073741824 Nov 06 19:38:50 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-5a5cdef1-7396-4945-b5b7-4d826f1fd804 tempest-VolumesDeleteCascade-576360817 None] Create snapshot completed successfully Nov 06 19:38:51 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c 1073741824" returned: 0 in 0.637s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:51 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c Nov 06 19:38:51 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:51 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c" returned: 0 in 0.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Creating offline snapshot 08a7fac2-3905-4a40-b85c-77e9e3a879c4 of volume 01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4abd37e-2d7b-4bcc-9a3e-054140ba23c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab23e83d-ef95-4642-b40f-dde606a6887c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25df93c-ccd3-489e-9503-872ac6ac8798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c041094-406a-44aa-8068-1c46a517ee74]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Volume volume-ab23e83d-ef95-4642-b40f-dde606a6887c (ab23e83d-ef95-4642-b40f-dde606a6887c): created successfully Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25df93c-ccd3-489e-9503-872ac6ac8798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:38:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Flow 'volume_create_manager' (4deeece1-cc01-4498-97f1-e36dfa15203a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:38:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fc40874a-1159-4f86-8e0c-76faf62b4597 tempest-AttachVolumeShelveTestJSON-1105565959 None] Created volume successfully. Nov 06 19:38:52 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 Nov 06 19:38:52 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:52 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7" returned: 0 in 0.530s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a5323a-f041-422a-8cce-ec33b69440eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:38:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:52 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 1G Nov 06 19:38:52 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:53 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 1G" returned: 0 in 0.619s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:53 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 Nov 06 19:38:53 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:53 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4" returned: 0 in 0.399s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:53 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 is being set with open permissions: ugo+rw Nov 06 19:38:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:53 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 Nov 06 19:38:53 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:53 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4" returned: 0 in 0.314s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:38:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9d65ecc1-3931-4de3-b93c-bb7ae9e54379 tempest-VolumesDeleteCascade-576360817 None] Create snapshot completed successfully Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-01a5323a-f041-422a-8cce-ec33b69440eb-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-01a5323a-f041-422a-8cce-ec33b69440eb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Performing cascade delete. {{(pid=86928) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-08a7fac2-3905-4a40-b85c-77e9e3a879c4-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-08a7fac2-3905-4a40-b85c-77e9e3a879c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-08a7fac2-3905-4a40-b85c-77e9e3a879c4" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-08a7fac2-3905-4a40-b85c-77e9e3a879c4" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Deleting offline snapshot 08a7fac2-3905-4a40-b85c-77e9e3a879c4 of volume 01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] snapshot_file for this snap is: volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b0a92f-b0ce-4881-9d90-965a79ade554]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:56 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 Nov 06 19:38:56 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:56 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4" returned: 0 in 0.948s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a5323a-f041-422a-8cce-ec33b69440eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:38:56 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af0835-e3e7-4d29-bc97-937d58fe2681]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:56 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 Nov 06 19:38:56 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:57 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7" returned: 0 in 0.790s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a5323a-f041-422a-8cce-ec33b69440eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:38:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:57 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 Nov 06 19:38:57 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:58 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4" returned: 0 in 0.833s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:58 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4 Nov 06 19:38:58 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:58 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.08a7fac2-3905-4a40-b85c-77e9e3a879c4" returned: 0 in 0.313s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-08a7fac2-3905-4a40-b85c-77e9e3a879c4" released by "_delete_snapshot" :: held 3.118s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" released by "delete_snapshot" :: held 3.174s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:58 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Created reservations ['3fb5d705-3ad0-4642-b1fd-8c3820b9ba2b', '3a2b5616-5258-4856-a700-af3bd40c1f64', 'a9ebcea0-adb2-469a-b868-64aa38824190', '556d025e-1e2d-421a-aa85-54af25df5c29'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:38:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Delete snapshot completed successfully. Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-08a7fac2-3905-4a40-b85c-77e9e3a879c4-delete_snapshot" released by "delete_snapshot" :: held 3.532s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-c5b4f91c-1d9f-4d22-9845-1258908514c7-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-c5b4f91c-1d9f-4d22-9845-1258908514c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-c5b4f91c-1d9f-4d22-9845-1258908514c7" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-c5b4f91c-1d9f-4d22-9845-1258908514c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Deleting offline snapshot c5b4f91c-1d9f-4d22-9845-1258908514c7 of volume 01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] snapshot_file for this snap is: volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb13786-b33b-4221-868b-f48960835416]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:38:59 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 Nov 06 19:38:59 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:38:59 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7" returned: 0 in 0.575s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a5323a-f041-422a-8cce-ec33b69440eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[405512f9-987a-45a7-8ad6-798b80d3de5f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:38:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:00 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb Nov 06 19:39:00 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:00 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb" returned: 0 in 0.567s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:00 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 Nov 06 19:39:00 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:00 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7" returned: 0 in 0.496s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:00 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7 Nov 06 19:39:00 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:01 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb.c5b4f91c-1d9f-4d22-9845-1258908514c7" returned: 0 in 0.477s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-c5b4f91c-1d9f-4d22-9845-1258908514c7" released by "_delete_snapshot" :: held 2.300s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" released by "delete_snapshot" :: held 2.327s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Created reservations ['a1adf18a-87d4-41bb-8f4d-b09cf14dcddd', '2b0009ff-866c-4fca-b212-c1817b8f47a8', 'f2abe380-e415-4307-9fa2-04da21a1e4bb', '468db771-1bb6-4a8d-866b-e2d098fcd803'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Delete snapshot completed successfully. Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-c5b4f91c-1d9f-4d22-9845-1258908514c7-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Snapshots deleted, issuing volume delete {{(pid=86928) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" acquired by "delete_volume" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d9575-2370-45f8-8054-41da65d28b02]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:01 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb Nov 06 19:39:01 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:02 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb" returned: 0 in 0.630s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:02 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb Nov 06 19:39:02 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:02 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-01a5323a-f041-422a-8cce-ec33b69440eb" returned: 0 in 0.300s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-01a5323a-f041-422a-8cce-ec33b69440eb" released by "delete_volume" :: held 1.037s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Created reservations ['691d1500-a7ee-4d73-837c-8dc14bf87582', '53f55117-ea7b-41cc-a463-22704c0b2d4c', 'dca602dd-0a03-4bd4-8802-f190c6ec3018', 'c40fd990-f977-46a1-b34d-96a861024649'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:03 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:03 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:03 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.466s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:03 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Deleted volume successfully. Nov 06 19:39:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12773a60-c4a4-4822-852c-da741a0ec56f tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-01a5323a-f041-422a-8cce-ec33b69440eb-delete_volume" released by "delete_volume" :: held 8.177s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:04 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Flow 'volume_create_manager' (860edd5c-f7d7-45e6-b791-978cb189f608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bff7e6-1528-47d3-889f-8de08befea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bff7e6-1528-47d3-889f-8de08befea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-190459125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef7522c-61ad-43eb-a23a-c81199521bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fabe5c7a35745e88cad55f266f4a62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:05Z,use_quota=True,user_id='3fb8d6fa4cb04bc8a27700773dcbc811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3b637e-a86e-40c1-ae9e-6b437bddffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3b637e-a86e-40c1-ae9e-6b437bddffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aafaec-0a1f-4a85-a6d9-d7441a1e90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aafaec-0a1f-4a85-a6d9-d7441a1e90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef7522c-61ad-43eb-a23a-c81199521bd5', 'volume_name': 'volume-cef7522c-61ad-43eb-a23a-c81199521bd5', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f55ab-c605-4077-b379-aabea90972fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f55ab-c605-4077-b379-aabea90972fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58000cd0-4794-48d7-b8c8-393e88cd15e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Volume cef7522c-61ad-43eb-a23a-c81199521bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef7522c-61ad-43eb-a23a-c81199521bd5', 'volume_size': 1} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-190459125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef7522c-61ad-43eb-a23a-c81199521bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fabe5c7a35745e88cad55f266f4a62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:05Z,use_quota=True,user_id='3fb8d6fa4cb04bc8a27700773dcbc811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Creating volume cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:05 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:05 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 1073741824 Nov 06 19:39:05 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:05 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 1073741824" returned: 0 in 0.645s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:05 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 Nov 06 19:39:05 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:06 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5" returned: 0 in 0.399s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58000cd0-4794-48d7-b8c8-393e88cd15e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef7522c-61ad-43eb-a23a-c81199521bd5', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dbcf5f-e8f3-4073-83be-c2815aa9fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:06 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Volume volume-cef7522c-61ad-43eb-a23a-c81199521bd5 (cef7522c-61ad-43eb-a23a-c81199521bd5): created successfully Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dbcf5f-e8f3-4073-83be-c2815aa9fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Flow 'volume_create_manager' (860edd5c-f7d7-45e6-b791-978cb189f608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cf3660d6-9865-4bdc-8c99-0a963683f360 tempest-VolumesDeleteCascade-576360817 None] Created volume successfully. Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-18ad548b-9701-42f0-8029-c4558dd3a84e req-aa71a2f4-3b64-4990-b0c4-cd7cc5d83570 tempest-AttachVolumeShelveTestJSON-1105565959 None] No connector for attachment 7c434745-583c-4097-880b-dca09489b9d7; skipping storage backend terminate_connection call. {{(pid=86928) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 06 19:39:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-18ad548b-9701-42f0-8029-c4558dd3a84e req-aa71a2f4-3b64-4990-b0c4-cd7cc5d83570 tempest-AttachVolumeShelveTestJSON-1105565959 None] Deleting attachment 7c434745-583c-4097-880b-dca09489b9d7. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:39:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Creating offline snapshot 4994127b-4921-449a-a9af-d3da70e30727 of volume cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:39:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c94ed3-9978-41cf-9f19-501cf3eb2b9f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:07 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 Nov 06 19:39:07 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:08 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5" returned: 0 in 0.526s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:08 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 1G Nov 06 19:39:08 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:08 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 1G" returned: 0 in 0.618s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef7522c-61ad-43eb-a23a-c81199521bd5 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:08 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef7522c-61ad-43eb-a23a-c81199521bd5 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 Nov 06 19:39:08 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:09 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef7522c-61ad-43eb-a23a-c81199521bd5 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727" returned: 0 in 0.413s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:09 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 is being set with open permissions: ugo+rw Nov 06 19:39:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:09 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 Nov 06 19:39:09 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:09 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727" returned: 0 in 0.322s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:09 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.info Nov 06 19:39:09 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:10 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.info" returned: 0 in 0.566s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:10 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.info is being set with open permissions: ugo+rw Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:10 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.info Nov 06 19:39:10 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Flow 'volume_create_manager' (7071435a-762c-4319-aa09-f4e96104cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae51cbb-3817-499e-bb02-61588e5b159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae51cbb-3817-499e-bb02-61588e5b159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1868270914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6d5096-153a-4f57-ab02-d6965390b6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70c2548540a48638c3cf29029ccef42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:10Z,use_quota=True,user_id='d18b37d166864a62b23d6efb84326ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3dbc6e-846c-4a7f-8fae-deafb16a978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3dbc6e-846c-4a7f-8fae-deafb16a978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bcf16b-e7ee-4819-8b82-26fd1895347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bcf16b-e7ee-4819-8b82-26fd1895347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6d5096-153a-4f57-ab02-d6965390b6ae', 'volume_name': 'volume-3d6d5096-153a-4f57-ab02-d6965390b6ae', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e25a81-d29c-45ea-b6f5-49a3082a0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e25a81-d29c-45ea-b6f5-49a3082a0db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3346f-e493-4dc6-aeb6-e2ddcb65ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:10 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Volume 3d6d5096-153a-4f57-ab02-d6965390b6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6d5096-153a-4f57-ab02-d6965390b6ae', 'volume_size': 1} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:10 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.info" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.905s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1868270914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6d5096-153a-4f57-ab02-d6965390b6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70c2548540a48638c3cf29029ccef42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:10Z,use_quota=True,user_id='d18b37d166864a62b23d6efb84326ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Creating volume 3d6d5096-153a-4f57-ab02-d6965390b6ae {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:10 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:10 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae 1073741824 Nov 06 19:39:10 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-986e9b2c-8572-402e-87ac-baa1bdc8cd75 tempest-VolumesDeleteCascade-576360817 None] Create snapshot completed successfully Nov 06 19:39:10 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae 1073741824" returned: 0 in 0.495s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:10 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae Nov 06 19:39:10 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:11 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae" returned: 0 in 0.339s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3346f-e493-4dc6-aeb6-e2ddcb65ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6d5096-153a-4f57-ab02-d6965390b6ae', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86832a7-9726-46fd-86dc-cb351b5c32ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Volume volume-3d6d5096-153a-4f57-ab02-d6965390b6ae (3d6d5096-153a-4f57-ab02-d6965390b6ae): created successfully Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86832a7-9726-46fd-86dc-cb351b5c32ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Flow 'volume_create_manager' (7071435a-762c-4319-aa09-f4e96104cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4a365a03-3f75-453e-9c14-f5cf2f414283 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Created volume successfully. Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Flow 'volume_create_manager' (cc8cf1f1-b640-4f26-966a-8dcb33245950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003a6559-0e68-4a71-8175-fd505e6dfb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003a6559-0e68-4a71-8175-fd505e6dfb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-726624781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dea513d-e294-488d-bbea-7f0cff466881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fabe5c7a35745e88cad55f266f4a62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4994127b-4921-449a-a9af-d3da70e30727,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:11Z,use_quota=True,user_id='3fb8d6fa4cb04bc8a27700773dcbc811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04073d3-ef56-4569-85f1-abc59f667545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04073d3-ef56-4569-85f1-abc59f667545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46534f8-7cd5-4742-8a4a-2dc23e4dc4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46534f8-7cd5-4742-8a4a-2dc23e4dc4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4dea513d-e294-488d-bbea-7f0cff466881', 'volume_name': 'volume-4dea513d-e294-488d-bbea-7f0cff466881', 'volume_size': 1, 'snapshot_id': '4994127b-4921-449a-a9af-d3da70e30727'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b959e90-c807-428d-9e2e-951e52aa3940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b959e90-c807-428d-9e2e-951e52aa3940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a0db20-c2d5-43b6-9e37-a75730bd18c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Volume 4dea513d-e294-488d-bbea-7f0cff466881: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4dea513d-e294-488d-bbea-7f0cff466881', 'volume_size': 1, 'snapshot_id': '4994127b-4921-449a-a9af-d3da70e30727'} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-4994127b-4921-449a-a9af-d3da70e30727-4dea513d-e294-488d-bbea-7f0cff466881" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4994127b-4921-449a-a9af-d3da70e30727-4dea513d-e294-488d-bbea-7f0cff466881" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Creating volume 4dea513d-e294-488d-bbea-7f0cff466881 from snapshot 4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-4dea513d-e294-488d-bbea-7f0cff466881" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4dea513d-e294-488d-bbea-7f0cff466881" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] snapshot: 4994127b-4921-449a-a9af-d3da70e30727, volume: 4dea513d-e294-488d-bbea-7f0cff466881, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1746939-fa48-4e95-9caf-a28b3f0c057b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:11 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 Nov 06 19:39:11 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:11 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef7522c-61ad-43eb-a23a-c81199521bd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cbc5a1-8802-4109-99ea-4e80a07eacbc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:12 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 Nov 06 19:39:12 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Acquiring lock "cinder-3d6d5096-153a-4f57-ab02-d6965390b6ae-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "cinder-3d6d5096-153a-4f57-ab02-d6965390b6ae-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:12 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5" returned: 0 in 0.479s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:12 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Acquiring lock "cinder-quobyte-3d6d5096-153a-4f57-ab02-d6965390b6ae" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:12 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "cinder-quobyte-3d6d5096-153a-4f57-ab02-d6965390b6ae" acquired by "delete_volume" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[03299f04-005a-44c2-94b2-2a80798c729b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:12 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae Nov 06 19:39:12 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:13 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae" returned: 0 in 0.442s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:13 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae Nov 06 19:39:13 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:13 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3d6d5096-153a-4f57-ab02-d6965390b6ae" returned: 0 in 0.539s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "cinder-quobyte-3d6d5096-153a-4f57-ab02-d6965390b6ae" released by "delete_volume" :: held 1.050s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=84,cinder:INSERT=30,cinder:UPDATE=103,cinder:DELETE=9 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=90,cinder:UPDATE=107,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Created reservations ['3c1cbf54-5493-4051-b006-5bf05f201330', '76f2be9b-1d1e-4da2-bc47-1c46b8950a0f', 'd6000bb2-9fae-41c1-be3d-0e968e078f09', '17840101-e9e4-448a-9a4d-84f584e5b94a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:14 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:14 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:14 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.566s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:14 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Deleted volume successfully. Nov 06 19:39:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9f9418f7-177d-48b0-92c7-78f2ea74e8bc tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "cinder-3d6d5096-153a-4f57-ab02-d6965390b6ae-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Flow 'volume_create_manager' (82cea712-b8b4-4d62-af36-c12a69ccffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79d0c9a-6e5a-4e2a-81ba-840d7680f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79d0c9a-6e5a-4e2a-81ba-840d7680f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-200576154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70c2548540a48638c3cf29029ccef42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:16Z,use_quota=True,user_id='d18b37d166864a62b23d6efb84326ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bbbcd4-ac9e-420d-b30d-09bad82c34eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bbbcd4-ac9e-420d-b30d-09bad82c34eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a31c477-0501-449a-b817-22b08899412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a31c477-0501-449a-b817-22b08899412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7', 'volume_name': 'volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f6f425-f7d8-4c9c-968d-9eb384b0be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f6f425-f7d8-4c9c-968d-9eb384b0be2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790b2683-fff8-4ac0-bd37-a2b03a2900eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:16 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Volume 2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7', 'volume_size': 1} Nov 06 19:39:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:22 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881" returned: 0 in 9.868s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5, size 1024.00 MB, duration 9.87 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:39:22 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Converted 1024.00 MB image at 103.76 MB/s Nov 06 19:39:22 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 is being set with open permissions: ugo+rw Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:22 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 Nov 06 19:39:22 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Flow 'volume_create_manager' (c59f60a9-154d-4022-a89e-0ce6f9c3d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52822777-933d-44ed-be5d-4f29d1989263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52822777-933d-44ed-be5d-4f29d1989263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-53822635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ac3706-a6fe-4929-ae5a-40120f40af42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7844330f7bf466480caaac1b1d86c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:22Z,use_quota=True,user_id='9750a471c235405b83e1629dbdc28e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dab73f-aa58-4519-8e08-5da06cfadb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dab73f-aa58-4519-8e08-5da06cfadb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b2422b-ece8-400c-ae7d-fe6842dc7400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b2422b-ece8-400c-ae7d-fe6842dc7400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ac3706-a6fe-4929-ae5a-40120f40af42', 'volume_name': 'volume-b3ac3706-a6fe-4929-ae5a-40120f40af42', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56f7e92-a9ad-4f96-b98c-69c77563d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56f7e92-a9ad-4f96-b98c-69c77563d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9de390c-2384-4ad9-ada9-0679eff786ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:22 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Volume b3ac3706-a6fe-4929-ae5a-40120f40af42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ac3706-a6fe-4929-ae5a-40120f40af42', 'volume_size': 1} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:22 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881" returned: 0 in 0.326s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4dea513d-e294-488d-bbea-7f0cff466881" released by "_copy_volume_from_snapshot" :: held 11.179s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4994127b-4921-449a-a9af-d3da70e30727-4dea513d-e294-488d-bbea-7f0cff466881" released by "_create_volume_from_snapshot" :: held 11.240s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.257s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.559s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-200576154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70c2548540a48638c3cf29029ccef42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:16Z,use_quota=True,user_id='d18b37d166864a62b23d6efb84326ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Creating volume 2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:22 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:22 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 1073741824 Nov 06 19:39:22 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a0db20-c2d5-43b6-9e37-a75730bd18c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dea513d-e294-488d-bbea-7f0cff466881', 'volume_size': 1, 'snapshot_id': '4994127b-4921-449a-a9af-d3da70e30727'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbaab0c-bc0b-42b5-9305-195ca6e9d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:22 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Volume volume-4dea513d-e294-488d-bbea-7f0cff466881 (4dea513d-e294-488d-bbea-7f0cff466881): created successfully Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbaab0c-bc0b-42b5-9305-195ca6e9d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Flow 'volume_create_manager' (cc8cf1f1-b640-4f26-966a-8dcb33245950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:22 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-24a93dde-b899-4025-9829-44e160ee925d tempest-VolumesDeleteCascade-576360817 None] Created volume successfully. Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-cef7522c-61ad-43eb-a23a-c81199521bd5-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-cef7522c-61ad-43eb-a23a-c81199521bd5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Performing cascade delete. {{(pid=86928) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-4994127b-4921-449a-a9af-d3da70e30727-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-4994127b-4921-449a-a9af-d3da70e30727-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-cef7522c-61ad-43eb-a23a-c81199521bd5" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-cef7522c-61ad-43eb-a23a-c81199521bd5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-4994127b-4921-449a-a9af-d3da70e30727" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4994127b-4921-449a-a9af-d3da70e30727" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Deleting offline snapshot 4994127b-4921-449a-a9af-d3da70e30727 of volume cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] snapshot_file for this snap is: volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78400f2-3547-43b3-8d81-7ef6e82c7007]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:23 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 1073741824" returned: 0 in 0.598s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:23 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 Nov 06 19:39:23 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:23 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 Nov 06 19:39:23 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:23 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-53822635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ac3706-a6fe-4929-ae5a-40120f40af42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7844330f7bf466480caaac1b1d86c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:22Z,use_quota=True,user_id='9750a471c235405b83e1629dbdc28e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Creating volume b3ac3706-a6fe-4929-ae5a-40120f40af42 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:23 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:23 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727" returned: 0 in 0.472s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef7522c-61ad-43eb-a23a-c81199521bd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:39:23 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 1073741824 Nov 06 19:39:23 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b4942-a2c6-4bc1-b1ea-bf31760e296b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790b2683-fff8-4ac0-bd37-a2b03a2900eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bf4ece-9a2f-4f80-9a2f-3e37488d7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:23 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Volume volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 (2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7): created successfully Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bf4ece-9a2f-4f80-9a2f-3e37488d7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Flow 'volume_create_manager' (82cea712-b8b4-4d62-af36-c12a69ccffce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:23 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-da3bd9a1-8667-45cb-830a-378055804cc2 tempest-VolumeQuotasAdminTestJSON-1733554474 None] Created volume successfully. Nov 06 19:39:23 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 Nov 06 19:39:24 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:24 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 1073741824" returned: 0 in 0.510s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:24 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 Nov 06 19:39:24 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:24 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5" returned: 0 in 0.701s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:24 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 Nov 06 19:39:24 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:24 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42" returned: 0 in 0.275s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9de390c-2384-4ad9-ada9-0679eff786ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ac3706-a6fe-4929-ae5a-40120f40af42', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12904399-fb65-4bcd-9b3d-00e93ab3ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:24 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Volume volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 (b3ac3706-a6fe-4929-ae5a-40120f40af42): created successfully Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12904399-fb65-4bcd-9b3d-00e93ab3ac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Flow 'volume_create_manager' (c59f60a9-154d-4022-a89e-0ce6f9c3d738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:24 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c63c61d5-cdcf-4cf5-809b-b890e705b36f tempest-AttachVolumeNegativeTest-2114870787 None] Created volume successfully. Nov 06 19:39:24 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727" returned: 0 in 0.417s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:24 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727 Nov 06 19:39:24 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:25 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5.4994127b-4921-449a-a9af-d3da70e30727" returned: 0 in 0.262s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4994127b-4921-449a-a9af-d3da70e30727" released by "_delete_snapshot" :: held 1.971s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-cef7522c-61ad-43eb-a23a-c81199521bd5" released by "delete_snapshot" :: held 2.004s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Created reservations ['3f85f03d-8076-452a-bba7-599855afce56', '5253dc4e-8099-40a6-8598-80194ab972a3', 'd77205cc-cc40-4d2a-974f-945d5796d654', '5f0d6500-47d3-41ac-afbe-7c894899a07a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Delete snapshot completed successfully. Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-4994127b-4921-449a-a9af-d3da70e30727-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Snapshots deleted, issuing volume delete {{(pid=86928) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-cef7522c-61ad-43eb-a23a-c81199521bd5" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-cef7522c-61ad-43eb-a23a-c81199521bd5" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e627f1-c7f5-46fb-99c0-9a28f71b5af7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:25 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 Nov 06 19:39:25 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:25 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-af77de36-0bae-4246-b845-a42c1e5ed412 tempest-VolumeQuotasAdminTestJSON-1705463906 None] Transfer volume completed successfully. Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5" returned: 0 in 0.434s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:25 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5 Nov 06 19:39:25 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:26 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cef7522c-61ad-43eb-a23a-c81199521bd5" returned: 0 in 0.406s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-cef7522c-61ad-43eb-a23a-c81199521bd5" released by "delete_volume" :: held 0.940s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Created reservations ['25f12212-4fe3-4b20-a14c-9cc3cee56bd9', '07259294-2d04-4490-860b-2c86685a250c', '49f149f3-80bb-4f5b-9e87-9c730c033e4e', '1eed6c2e-7eae-4ee4-bef8-128d744a830c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-8abf3b20-0a57-4801-bca3-b7224a5ddf9e req-b3d1fbab-51f2-4a4b-a191-b38e8474bb79 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-8abf3b20-0a57-4801-bca3-b7224a5ddf9e req-b3d1fbab-51f2-4a4b-a191-b38e8474bb79 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:26 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:26 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-8abf3b20-0a57-4801-bca3-b7224a5ddf9e req-b3d1fbab-51f2-4a4b-a191-b38e8474bb79 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-8abf3b20-0a57-4801-bca3-b7224a5ddf9e req-b3d1fbab-51f2-4a4b-a191-b38e8474bb79 tempest-AttachVolumeNegativeTest-2114870787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-b3ac3706-a6fe-4929-ae5a-40120f40af42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9da787f4-cefa-4c70-82de-a22aa07344f5', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:39:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-8abf3b20-0a57-4801-bca3-b7224a5ddf9e req-b3d1fbab-51f2-4a4b-a191-b38e8474bb79 tempest-AttachVolumeNegativeTest-2114870787 None] attachment_update completed successfully. Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Acquiring lock "cinder-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Lock "cinder-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Acquiring lock "cinder-quobyte-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Lock "cinder-quobyte-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412ed2f-1ddf-4b07-8f46-9be22e8985a3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:27 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.410s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:27 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Deleted volume successfully. Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-687b6840-2644-4958-a5b2-c2d56310f7cf tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-cef7522c-61ad-43eb-a23a-c81199521bd5-delete_volume" released by "delete_volume" :: held 3.972s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:27 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 Nov 06 19:39:27 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:27 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7" returned: 0 in 0.531s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:27 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7 Nov 06 19:39:27 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-4dea513d-e294-488d-bbea-7f0cff466881-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-4dea513d-e294-488d-bbea-7f0cff466881-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:27 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "cinder-quobyte-4dea513d-e294-488d-bbea-7f0cff466881" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7" returned: 0 in 0.435s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Lock "cinder-quobyte-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7" released by "delete_volume" :: held 1.034s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4dea513d-e294-488d-bbea-7f0cff466881" acquired by "delete_volume" :: waited 0.048s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5894a483-432c-4d43-a323-aeca69d026fe]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Created reservations ['0fd0cf93-5074-42c1-a048-bc390f157933', '846d13c1-b4ff-4167-aec5-af80632a80df', '10e6fce7-0798-4eaa-8ea2-6286b5cfef29', 'efa8b459-3f68-401b-9c79-e91b24cedbd3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:28 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 Nov 06 19:39:28 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:28 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:28 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:28 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.281s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:28 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881" returned: 0 in 0.419s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Deleted volume successfully. Nov 06 19:39:28 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881 Nov 06 19:39:28 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eb93afcf-8478-4cad-b76e-8994b5f4891f tempest-VolumeQuotasAdminTestJSON-1319815909 None] Lock "cinder-2f4e0f22-2296-4c8f-9f4f-623f9a2a33b7-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:28 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4dea513d-e294-488d-bbea-7f0cff466881" returned: 0 in 0.265s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-quobyte-4dea513d-e294-488d-bbea-7f0cff466881" released by "delete_volume" :: held 0.739s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Created reservations ['a0a0da98-b47b-4785-bd5c-da59b0fdf5f8', 'e4a374c0-2385-478e-932a-39a96eb9a4aa', '36dbb21b-248d-4c81-a40d-975724dd0fb7', 'e38e3b0f-f0d2-441f-97bc-57a2b9271779'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:28 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:28 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:29 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.363s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:29 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Deleted volume successfully. Nov 06 19:39:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4c23316-71df-409c-8f78-024d9df4d71d tempest-VolumesDeleteCascade-576360817 None] Lock "cinder-4dea513d-e294-488d-bbea-7f0cff466881-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Flow 'volume_create_manager' (2cb72efb-aac4-4d56-a57f-bc4e844ce316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd2c2a8-ad06-44ff-bb1d-563a3707b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd2c2a8-ad06-44ff-bb1d-563a3707b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-684130084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9835ed-9e7a-4a31-bea7-9d004921e455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487145eb6731440291945a6b7100ce78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:37Z,use_quota=True,user_id='a56604e742834ee3b39e35bc37b41e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fca450-3c7b-443d-9096-46b4003f65cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fca450-3c7b-443d-9096-46b4003f65cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13e70cc-e0eb-4278-9816-dbaea6978d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13e70cc-e0eb-4278-9816-dbaea6978d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9835ed-9e7a-4a31-bea7-9d004921e455', 'volume_name': 'volume-4c9835ed-9e7a-4a31-bea7-9d004921e455', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28a8798-40ce-46d0-a669-4a881742e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28a8798-40ce-46d0-a669-4a881742e309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d47425-5faf-41b6-9826-9beef26ef95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Volume 4c9835ed-9e7a-4a31-bea7-9d004921e455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9835ed-9e7a-4a31-bea7-9d004921e455', 'volume_size': 1} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-684130084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9835ed-9e7a-4a31-bea7-9d004921e455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487145eb6731440291945a6b7100ce78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:37Z,use_quota=True,user_id='a56604e742834ee3b39e35bc37b41e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Creating volume 4c9835ed-9e7a-4a31-bea7-9d004921e455 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:37 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:39:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:37 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 1073741824 Nov 06 19:39:37 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:38 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 1073741824" returned: 0 in 0.715s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:38 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 Nov 06 19:39:38 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:38 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455" returned: 0 in 0.546s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d47425-5faf-41b6-9826-9beef26ef95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9835ed-9e7a-4a31-bea7-9d004921e455', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4a4789-d762-47dd-937f-40ef4b84cd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:38 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Volume volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 (4c9835ed-9e7a-4a31-bea7-9d004921e455): created successfully Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4a4789-d762-47dd-937f-40ef4b84cd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Flow 'volume_create_manager' (2cb72efb-aac4-4d56-a57f-bc4e844ce316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-71a54466-06dc-4930-bea1-428cc24082d4 tempest-VolumesTransfersTest-1083726663 None] Created volume successfully. Nov 06 19:39:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0c440285-b84f-4c69-884a-cf5749bd3dd2 tempest-VolumesTransfersTest-1002887887 None] Transfer volume completed successfully. Nov 06 19:39:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Acquiring lock "cinder-4c9835ed-9e7a-4a31-bea7-9d004921e455-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-4c9835ed-9e7a-4a31-bea7-9d004921e455-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Acquiring lock "cinder-quobyte-4c9835ed-9e7a-4a31-bea7-9d004921e455" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-quobyte-4c9835ed-9e7a-4a31-bea7-9d004921e455" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054660f-30bb-4838-9b5a-71ec6e575a3e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:42 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 Nov 06 19:39:42 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:42 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455" returned: 0 in 0.542s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:42 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455 Nov 06 19:39:42 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:43 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4c9835ed-9e7a-4a31-bea7-9d004921e455" returned: 0 in 0.385s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-quobyte-4c9835ed-9e7a-4a31-bea7-9d004921e455" released by "delete_volume" :: held 1.024s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Created reservations ['75d70f20-c2e3-47e0-a193-cd016df4245c', '10c82089-911e-40d7-be13-e4efd928e9a9', '3393f0bc-84f4-4716-aa5a-e5ea0b0e4ee6', '1dbc8729-a536-4ba6-be39-77f432f34e12'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:43 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:43 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:43 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.352s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Deleted volume successfully. Nov 06 19:39:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-316bdec1-bc86-4e2d-855a-cd534a4bedf9 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-4c9835ed-9e7a-4a31-bea7-9d004921e455-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Flow 'volume_create_manager' (556ce7e2-a2ac-4afd-8e0a-055b4e6908f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780e170-506c-42b7-a13a-137146bf8fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780e170-506c-42b7-a13a-137146bf8fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1663149482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b150477-db48-41b7-9c94-28bcf847d2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487145eb6731440291945a6b7100ce78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:45Z,use_quota=True,user_id='a56604e742834ee3b39e35bc37b41e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c358902e-99ab-46ed-987c-aef2128af0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c358902e-99ab-46ed-987c-aef2128af0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb568db-7786-4e22-bd19-64193a8ab7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb568db-7786-4e22-bd19-64193a8ab7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b150477-db48-41b7-9c94-28bcf847d2b7', 'volume_name': 'volume-2b150477-db48-41b7-9c94-28bcf847d2b7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98149c9-7ea2-4719-9bf6-ffcb13c94f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98149c9-7ea2-4719-9bf6-ffcb13c94f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f89b9cf-8e93-4095-927b-60cb8fc36ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:44 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Volume 2b150477-db48-41b7-9c94-28bcf847d2b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b150477-db48-41b7-9c94-28bcf847d2b7', 'volume_size': 1} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1663149482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b150477-db48-41b7-9c94-28bcf847d2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487145eb6731440291945a6b7100ce78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:45Z,use_quota=True,user_id='a56604e742834ee3b39e35bc37b41e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Creating volume 2b150477-db48-41b7-9c94-28bcf847d2b7 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:44 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:39:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:45 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 1073741824 Nov 06 19:39:45 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:45 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 1073741824" returned: 0 in 0.778s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:45 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 Nov 06 19:39:45 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:46 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7" returned: 0 in 0.536s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:39:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f89b9cf-8e93-4095-927b-60cb8fc36ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b150477-db48-41b7-9c94-28bcf847d2b7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e2b35c-0c49-4ba4-8c31-547f65090fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:46 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Volume volume-2b150477-db48-41b7-9c94-28bcf847d2b7 (2b150477-db48-41b7-9c94-28bcf847d2b7): created successfully Nov 06 19:39:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e2b35c-0c49-4ba4-8c31-547f65090fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Flow 'volume_create_manager' (556ce7e2-a2ac-4afd-8e0a-055b4e6908f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2b92394e-b710-4cc2-a9e0-de118661d806 tempest-VolumesTransfersTest-1083726663 None] Created volume successfully. Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:47 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:47 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Acquiring lock "cinder-2b150477-db48-41b7-9c94-28bcf847d2b7-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-2b150477-db48-41b7-9c94-28bcf847d2b7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Acquiring lock "cinder-quobyte-2b150477-db48-41b7-9c94-28bcf847d2b7" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-quobyte-2b150477-db48-41b7-9c94-28bcf847d2b7" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f12e26c-b4f7-408b-9f80-3eb605dcaf08]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:47 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.522s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:39:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:39:47 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 Nov 06 19:39:47 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:48 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7" returned: 0 in 0.493s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:48 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7 Nov 06 19:39:48 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:48 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b150477-db48-41b7-9c94-28bcf847d2b7" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-quobyte-2b150477-db48-41b7-9c94-28bcf847d2b7" released by "delete_volume" :: held 0.924s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Created reservations ['79f67942-986d-4534-96ed-22290d613721', '230abc8d-8019-4881-a903-a843e0d96aae', '05d65711-d778-40f3-8262-70fc73f0647c', '05279d86-5bb8-43c2-92e0-cc7ce3cce4c3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:48 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:48 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:49 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.408s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Deleted volume successfully. Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3a43224-d83d-41ea-b57d-f84c6ae68191 tempest-VolumesTransfersTest-1207321174 None] Lock "cinder-2b150477-db48-41b7-9c94-28bcf847d2b7-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Acquiring lock "cinder-ab23e83d-ef95-4642-b40f-dde606a6887c-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "cinder-ab23e83d-ef95-4642-b40f-dde606a6887c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Acquiring lock "cinder-quobyte-ab23e83d-ef95-4642-b40f-dde606a6887c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "cinder-quobyte-ab23e83d-ef95-4642-b40f-dde606a6887c" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e92096f-9ceb-43c7-80a8-9c305db66dbe]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:49 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c Nov 06 19:39:49 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:50 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c" returned: 0 in 0.449s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:50 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c Nov 06 19:39:50 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:50 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab23e83d-ef95-4642-b40f-dde606a6887c" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "cinder-quobyte-ab23e83d-ef95-4642-b40f-dde606a6887c" released by "delete_volume" :: held 0.898s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Created reservations ['98330ab3-d321-4f7f-b773-88b0b80e502f', '8c43767a-7946-49bd-a507-4825cfccb14d', '62cf583b-f8ff-4aed-b7eb-8485244c4089', '671635d8-718c-4296-aae9-9c177ea69ddb'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:50 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:39:50 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:50 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.302s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:50 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:39:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Deleted volume successfully. Nov 06 19:39:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-288875b4-20f8-44c2-b6e9-48b8ce89ea73 tempest-AttachVolumeShelveTestJSON-1105565959 None] Lock "cinder-ab23e83d-ef95-4642-b40f-dde606a6887c-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:51 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Flow 'volume_create_manager' (51010287-e4db-4788-a0b9-922266c27d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfc579c-5b8a-434d-8984-cb315fa5b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfc579c-5b8a-434d-8984-cb315fa5b86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2005998628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc912438-74dc-4f22-805f-0c6fcdcd4993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef037b66b534629ae96a7a0e1097777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:52Z,use_quota=True,user_id='164049e2a51b41c18cc8ea4a4ad411ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78dd980-6b50-48b7-917d-98c7cd79dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78dd980-6b50-48b7-917d-98c7cd79dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6936a9f4-fbb1-41d2-a7a1-d89318c272ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6936a9f4-fbb1-41d2-a7a1-d89318c272ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc912438-74dc-4f22-805f-0c6fcdcd4993', 'volume_name': 'volume-cc912438-74dc-4f22-805f-0c6fcdcd4993', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b433ac-fef4-435d-ad23-d37f675e8c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b433ac-fef4-435d-ad23-d37f675e8c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad5e049-bdc8-4787-8dd9-2392bf13b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Volume cc912438-74dc-4f22-805f-0c6fcdcd4993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc912438-74dc-4f22-805f-0c6fcdcd4993', 'volume_size': 1} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2005998628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc912438-74dc-4f22-805f-0c6fcdcd4993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef037b66b534629ae96a7a0e1097777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:39:52Z,use_quota=True,user_id='164049e2a51b41c18cc8ea4a4ad411ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Creating volume cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:39:52 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:52 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 1073741824 Nov 06 19:39:52 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:52 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 1073741824" returned: 0 in 0.625s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:52 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 Nov 06 19:39:52 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:53 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:39:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad5e049-bdc8-4787-8dd9-2392bf13b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc912438-74dc-4f22-805f-0c6fcdcd4993', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8573e6d-6f3c-4571-9f76-d4bb01b78242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:39:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Volume volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 (cc912438-74dc-4f22-805f-0c6fcdcd4993): created successfully Nov 06 19:39:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8573e6d-6f3c-4571-9f76-d4bb01b78242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:39:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Flow 'volume_create_manager' (51010287-e4db-4788-a0b9-922266c27d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:39:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-91918e2b-d94f-40e6-a4cb-ca2602c1c6f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Created volume successfully. Nov 06 19:39:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:39:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:39:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Creating offline snapshot e726c78d-0699-4713-b117-be05b1328080 of volume cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:39:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96f824c-83bd-4366-856e-aaed96c9c48f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:54 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 Nov 06 19:39:54 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:54 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993" returned: 0 in 0.415s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:54 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 1G Nov 06 19:39:54 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:55 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 1G" returned: 0 in 0.508s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:55 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 Nov 06 19:39:55 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:55 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080" returned: 0 in 0.301s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:55 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 is being set with open permissions: ugo+rw Nov 06 19:39:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:55 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 Nov 06 19:39:55 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:55 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080" returned: 0 in 0.271s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:55 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.info Nov 06 19:39:55 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:56 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.info" returned: 0 in 0.354s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:56 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.info is being set with open permissions: ugo+rw Nov 06 19:39:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:56 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.info Nov 06 19:39:56 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:56 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.info" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:39:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3e3472df-bb1e-43ce-85d9-5384f64b3e46 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Create snapshot completed successfully Nov 06 19:39:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "cinder-e726c78d-0699-4713-b117-be05b1328080-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-e726c78d-0699-4713-b117-be05b1328080-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "cinder-quobyte-cc912438-74dc-4f22-805f-0c6fcdcd4993" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-quobyte-cc912438-74dc-4f22-805f-0c6fcdcd4993" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "cinder-quobyte-e726c78d-0699-4713-b117-be05b1328080" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-quobyte-e726c78d-0699-4713-b117-be05b1328080" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Deleting offline snapshot e726c78d-0699-4713-b117-be05b1328080 of volume cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] snapshot_file for this snap is: volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bccba2-f348-4a86-b8b6-0ee487697926]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:58 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 Nov 06 19:39:58 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:58 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080" returned: 0 in 0.441s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc912438-74dc-4f22-805f-0c6fcdcd4993(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d079f1-0f74-4b06-9f0d-b375caf1c6c0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:58 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 Nov 06 19:39:58 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:58 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993" returned: 0 in 0.408s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:59 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 Nov 06 19:39:59 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:59 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080" returned: 0 in 0.418s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:39:59 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080 Nov 06 19:39:59 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:39:59 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Nov 06 19:39:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993.e726c78d-0699-4713-b117-be05b1328080" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:39:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-quobyte-e726c78d-0699-4713-b117-be05b1328080" released by "_delete_snapshot" :: held 1.749s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-quobyte-cc912438-74dc-4f22-805f-0c6fcdcd4993" released by "delete_snapshot" :: held 1.795s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:39:59 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Created reservations ['a37aadf1-b712-4029-a2f4-739ef9d44c3b', '1767e78e-8623-48ad-88cf-b08b0d88b4ef', '8554c1ae-1d60-42ca-9982-77f13a220f64', 'e1239948-b2c5-4e53-88c4-766edcbd43cc'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:39:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Delete snapshot completed successfully. Nov 06 19:39:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-423ee741-e36a-4a64-8ee9-0e270ba98633 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-e726c78d-0699-4713-b117-be05b1328080-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "cinder-cc912438-74dc-4f22-805f-0c6fcdcd4993-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-cc912438-74dc-4f22-805f-0c6fcdcd4993-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "cinder-quobyte-cc912438-74dc-4f22-805f-0c6fcdcd4993" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-quobyte-cc912438-74dc-4f22-805f-0c6fcdcd4993" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38583d9-95ea-441b-a951-54a893a00968]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:00 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 Nov 06 19:40:00 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:01 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993" returned: 0 in 0.596s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:01 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993 Nov 06 19:40:01 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:01 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc912438-74dc-4f22-805f-0c6fcdcd4993" returned: 0 in 0.264s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-quobyte-cc912438-74dc-4f22-805f-0c6fcdcd4993" released by "delete_volume" :: held 1.060s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Created reservations ['3d641189-df26-4013-9a09-9fce63b671df', '9681e0c0-0599-441c-8c85-473b3c68b595', '5bded883-c236-49d5-b0a3-5535c0428fb6', '0a9c8be5-971f-4778-89ba-61cdfbe29b90'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:01 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:01 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:02 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.457s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:02 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Deleted volume successfully. Nov 06 19:40:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-355f856c-c6de-49f2-8439-108db722c358 tempest-VolumeSnapshotQuotasNegativeTestJSON-1258925832 None] Lock "cinder-cc912438-74dc-4f22-805f-0c6fcdcd4993-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7c986e72-4615-41c4-8bde-73b7ac3960d6 tempest-GroupsV314Test-1634155670 None] Group tempest-GroupsV314Test-Group-1607213062: creating Nov 06 19:40:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7c986e72-4615-41c4-8bde-73b7ac3960d6 tempest-GroupsV314Test-1634155670 None] Group tempest-GroupsV314Test-Group-1607213062: created successfully Nov 06 19:40:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7c986e72-4615-41c4-8bde-73b7ac3960d6 tempest-GroupsV314Test-1634155670 None] Create group completed successfully. Nov 06 19:40:03 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Flow 'volume_create_manager' (0334844d-7b3d-4d27-8001-b02a107882e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654defac-ddf9-4360-b613-610f0cfa66c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654defac-ddf9-4360-b613-610f0cfa66c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-732139379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d81a4b8-2856-4858-b130-c264c6e89dff,host='devstack@QuobyteHD#QuobyteHD',id=25cac34b-2f82-46a8-94f8-7900c13e5dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a085bbe64a54d3284ad7623a54c0a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:04Z,use_quota=True,user_id='9e8257e171d74614aa8e16c2f60693df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c841e990-a6e9-4ac1-8c65-24d4bd436cb1),volume_type_id=c841e990-a6e9-4ac1-8c65-24d4bd436cb1)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0480cd8-0574-4108-8fb3-ac317bf1ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0480cd8-0574-4108-8fb3-ac317bf1ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4dd5ae-ebb1-47c4-8bb3-f36bd6599d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4dd5ae-ebb1-47c4-8bb3-f36bd6599d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cac34b-2f82-46a8-94f8-7900c13e5dca', 'volume_name': 'volume-25cac34b-2f82-46a8-94f8-7900c13e5dca', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d91b81-e142-4241-a404-6b8837f18b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d91b81-e142-4241-a404-6b8837f18b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dcdeb8-1a4c-46cf-b91a-df07d2470a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:04 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Volume 25cac34b-2f82-46a8-94f8-7900c13e5dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cac34b-2f82-46a8-94f8-7900c13e5dca', 'volume_size': 1} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d81a4b8-2856-4858-b130-c264c6e89dff,created_at=2026-11-06T18:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-732139379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d81a4b8-2856-4858-b130-c264c6e89dff,host='devstack@QuobyteHD#QuobyteHD',id=25cac34b-2f82-46a8-94f8-7900c13e5dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a085bbe64a54d3284ad7623a54c0a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:04Z,use_quota=True,user_id='9e8257e171d74614aa8e16c2f60693df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c841e990-a6e9-4ac1-8c65-24d4bd436cb1),volume_type_id=c841e990-a6e9-4ac1-8c65-24d4bd436cb1)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Creating volume 25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:04 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:04 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca 1073741824 Nov 06 19:40:04 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:04 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca 1073741824" returned: 0 in 0.621s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:04 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca Nov 06 19:40:04 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:05 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca" returned: 0 in 0.449s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dcdeb8-1a4c-46cf-b91a-df07d2470a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cac34b-2f82-46a8-94f8-7900c13e5dca', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705f1fe0-ef82-44a2-b27d-2cd7d837bd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Volume volume-25cac34b-2f82-46a8-94f8-7900c13e5dca (25cac34b-2f82-46a8-94f8-7900c13e5dca): created successfully Nov 06 19:40:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705f1fe0-ef82-44a2-b27d-2cd7d837bd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Flow 'volume_create_manager' (0334844d-7b3d-4d27-8001-b02a107882e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-44afa702-ff17-48bc-93d5-4ffc6ea93cd7 tempest-GroupsV314Test-1634155670 None] Created volume successfully. Nov 06 19:40:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:07 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Cloning volume 25cac34b-2f82-46a8-94f8-7900c13e5dca to volume 95e830aa-be8a-45c2-a8ec-297689bce8f6 Nov 06 19:40:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Creating offline snapshot be6276fb-72d3-4046-a678-e0e532805da9 of volume 25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:40:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb9f5e7-ef48-4495-9b0d-57a6a5f3536f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:07 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca Nov 06 19:40:07 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:07 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca" returned: 0 in 0.579s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:07 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 1G Nov 06 19:40:07 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:08 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 1G" returned: 0 in 0.753s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cac34b-2f82-46a8-94f8-7900c13e5dca -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:08 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cac34b-2f82-46a8-94f8-7900c13e5dca -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 Nov 06 19:40:08 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:09 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cac34b-2f82-46a8-94f8-7900c13e5dca -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9" returned: 0 in 0.427s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:09 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:40:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:09 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 Nov 06 19:40:09 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:09 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:09 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.info Nov 06 19:40:09 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:09 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.info" returned: 0 in 0.304s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:09 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:40:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:09 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.info Nov 06 19:40:09 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:10 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.info" returned: 0 in 0.376s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Acquiring lock "cinder-quobyte-95e830aa-be8a-45c2-a8ec-297689bce8f6" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-95e830aa-be8a-45c2-a8ec-297689bce8f6" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] snapshot: be6276fb-72d3-4046-a678-e0e532805da9, volume: 95e830aa-be8a-45c2-a8ec-297689bce8f6, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[58435f84-569e-4b16-9006-8cda8751bc19]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:10 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 Nov 06 19:40:10 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:10 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9" returned: 0 in 0.488s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25cac34b-2f82-46a8-94f8-7900c13e5dca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7abf068-52bb-4415-82ee-3c78d4c904ac]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:10 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca Nov 06 19:40:10 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:11 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca" returned: 0 in 0.527s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:40:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:40:11 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:40:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:11 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 Nov 06 19:40:11 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-2d318423-262e-452f-97df-ed1504f7e28d req-34967694-d99a-40c9-a8b8-c00b66a22386 tempest-AttachVolumeNegativeTest-2114870787 None] Terminate volume connection completed successfully. Nov 06 19:40:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-2d318423-262e-452f-97df-ed1504f7e28d req-34967694-d99a-40c9-a8b8-c00b66a22386 tempest-AttachVolumeNegativeTest-2114870787 None] Deleting attachment 9da787f4-cefa-4c70-82de-a22aa07344f5. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:40:19 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=91,cinder:INSERT=29,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:40:20 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6" returned: 0 in 9.679s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:20 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca, size 1024.00 MB, duration 9.68 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:40:20 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Converted 1024.00 MB image at 105.78 MB/s Nov 06 19:40:20 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:40:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:21 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 Nov 06 19:40:21 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:21 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6" returned: 0 in 0.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-95e830aa-be8a-45c2-a8ec-297689bce8f6" released by "_copy_volume_from_snapshot" :: held 11.159s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Acquiring lock "cinder-quobyte-be6276fb-72d3-4046-a678-e0e532805da9" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-be6276fb-72d3-4046-a678-e0e532805da9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Deleting offline snapshot be6276fb-72d3-4046-a678-e0e532805da9 of volume 25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] snapshot_file for this snap is: volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec666036-471a-40b6-a5f9-872c18b8c3f9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:21 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 Nov 06 19:40:21 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=102,cinder:SELECT=72,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:40:21 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9" returned: 0 in 0.406s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25cac34b-2f82-46a8-94f8-7900c13e5dca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5409894-cfba-4812-ac98-27dbe0026b02]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:22 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca Nov 06 19:40:22 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:22 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca" returned: 0 in 0.601s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:22 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 Nov 06 19:40:22 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:23 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9" returned: 0 in 0.514s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:23 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9 Nov 06 19:40:23 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:23 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca.be6276fb-72d3-4046-a678-e0e532805da9" returned: 0 in 0.329s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-be6276fb-72d3-4046-a678-e0e532805da9" released by "_delete_snapshot" :: held 1.995s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.166s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:23 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e9748193-8e5a-4744-8ccc-76f4d42b1410 tempest-GroupsV314Test-1634155670 None] Create group from source-group-3d81a4b8-2856-4858-b130-c264c6e89dff completed successfully. Nov 06 19:40:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Acquiring lock "cinder-quobyte-95e830aa-be8a-45c2-a8ec-297689bce8f6" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-95e830aa-be8a-45c2-a8ec-297689bce8f6" acquired by "delete_volume" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:24 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f8e316-7711-40fc-81ce-9e699b7ebfdc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:24 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 Nov 06 19:40:24 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:25 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6" returned: 0 in 0.546s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:25 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6 Nov 06 19:40:25 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:25 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-95e830aa-be8a-45c2-a8ec-297689bce8f6" returned: 0 in 0.422s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-95e830aa-be8a-45c2-a8ec-297689bce8f6" released by "delete_volume" :: held 1.052s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Created reservations ['7f2561f5-410f-436b-84d7-bba80501a776'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:25 devstack cinder-volume[86928]: WARNING cinder.quota [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1058877714 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1058877714, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:40:25 devstack cinder-volume[86928]: WARNING cinder.quota [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1058877714 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1058877714, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Created reservations ['acece6e7-24f2-4d42-8bf1-bf77acd6a88b', '7345113a-a2ec-47dc-871b-1d3e341300cb', '947a9171-4339-4c25-a608-a193a87abc8f', '4d83b6ca-d27d-4201-83fe-19a4777941c2'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:25 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:25 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:26 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.395s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:26 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7c40c28d-e16f-4192-aaac-0b9bba760e6d tempest-GroupsV314Test-1634155670 None] Delete group completed successfully. Nov 06 19:40:26 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Flow 'volume_create_manager' (e80ad8a1-b57c-47c5-a709-929267b599f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13305970-cbb6-47b0-b1a4-30323b1d9cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13305970-cbb6-47b0-b1a4-30323b1d9cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1190603327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668267e2-9fff-416f-a5ae-31540e656f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f5009b1a3472389186bc6b9a6694e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:27Z,use_quota=True,user_id='03b897f31cf7455caa529b6d255d7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66e19e8-a5fa-4856-9c9d-bb422b5e34bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66e19e8-a5fa-4856-9c9d-bb422b5e34bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac85c98-eeaa-4fcc-b743-3a197dec4747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac85c98-eeaa-4fcc-b743-3a197dec4747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668267e2-9fff-416f-a5ae-31540e656f50', 'volume_name': 'volume-668267e2-9fff-416f-a5ae-31540e656f50', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc942d5-ef70-4c79-bf24-4c053c0c1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc942d5-ef70-4c79-bf24-4c053c0c1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebeb3989-8995-4bcc-866b-9ecfc6182002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:27 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Volume 668267e2-9fff-416f-a5ae-31540e656f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668267e2-9fff-416f-a5ae-31540e656f50', 'volume_size': 1} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1190603327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668267e2-9fff-416f-a5ae-31540e656f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f5009b1a3472389186bc6b9a6694e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:27Z,use_quota=True,user_id='03b897f31cf7455caa529b6d255d7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Creating volume 668267e2-9fff-416f-a5ae-31540e656f50 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:27 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:27 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 1073741824 Nov 06 19:40:27 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Acquiring lock "cinder-quobyte-25cac34b-2f82-46a8-94f8-7900c13e5dca" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-25cac34b-2f82-46a8-94f8-7900c13e5dca" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b05666a-ad2a-45bc-9bad-6fe7bbdf4f1c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:27 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca Nov 06 19:40:27 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:27 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 1073741824" returned: 0 in 0.709s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:27 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 Nov 06 19:40:27 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:27 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca" returned: 0 in 0.554s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:28 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca Nov 06 19:40:28 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:28 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50" returned: 0 in 0.426s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebeb3989-8995-4bcc-866b-9ecfc6182002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668267e2-9fff-416f-a5ae-31540e656f50', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:28 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a65cf51-454e-4934-a25e-7694981aa4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25cac34b-2f82-46a8-94f8-7900c13e5dca" returned: 0 in 0.364s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Lock "cinder-quobyte-25cac34b-2f82-46a8-94f8-7900c13e5dca" released by "delete_volume" :: held 1.009s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:28 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Volume volume-668267e2-9fff-416f-a5ae-31540e656f50 (668267e2-9fff-416f-a5ae-31540e656f50): created successfully Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a65cf51-454e-4934-a25e-7694981aa4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Flow 'volume_create_manager' (e80ad8a1-b57c-47c5-a709-929267b599f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a99d9916-2489-486e-8b27-5c20abcc6966 tempest-VolumesListAdminTestJSON-234640369 None] Created volume successfully. Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Created reservations ['f2a0d7d0-abc6-4d77-991d-5cd1b1b207ce'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Created reservations ['4264a29d-0581-41e7-a40e-60863aae05f6', '27454607-a03a-44fc-bb4d-8f5fb8ec6bb6', 'b870858a-1fff-4c6d-956e-602cb13d8d40', '3aeed3b7-606d-4fdf-9f12-8ecc118c7e38'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:28 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:28 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:28 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.334s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:28 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8cdcf26a-8404-4c48-a60c-30e011de6a0f tempest-GroupsV314Test-1634155670 None] Delete group completed successfully. Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Flow 'volume_create_manager' (749855c8-a838-4b6f-9557-0cff6cebf88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd4481-f3ec-44a2-abdd-b213220ec949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd4481-f3ec-44a2-abdd-b213220ec949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1643370934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a616bfdc-5ea0-45e9-82df-3acc011dafff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f5009b1a3472389186bc6b9a6694e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:30Z,use_quota=True,user_id='03b897f31cf7455caa529b6d255d7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578dc561-b642-4bd2-9b5e-9f1bb5357a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578dc561-b642-4bd2-9b5e-9f1bb5357a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befec54e-8719-4639-b2a9-fbd522fd4a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befec54e-8719-4639-b2a9-fbd522fd4a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a616bfdc-5ea0-45e9-82df-3acc011dafff', 'volume_name': 'volume-a616bfdc-5ea0-45e9-82df-3acc011dafff', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749abbf0-b2b3-4486-8a4b-35e6141541ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749abbf0-b2b3-4486-8a4b-35e6141541ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbeecdf-eec4-43d6-801b-463f22858c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:29 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Volume a616bfdc-5ea0-45e9-82df-3acc011dafff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a616bfdc-5ea0-45e9-82df-3acc011dafff', 'volume_size': 1} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1643370934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a616bfdc-5ea0-45e9-82df-3acc011dafff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f5009b1a3472389186bc6b9a6694e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:30Z,use_quota=True,user_id='03b897f31cf7455caa529b6d255d7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Creating volume a616bfdc-5ea0-45e9-82df-3acc011dafff {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:29 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:29 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff 1073741824 Nov 06 19:40:29 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:30 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff 1073741824" returned: 0 in 0.619s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:30 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff Nov 06 19:40:30 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:30 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff" returned: 0 in 0.437s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbeecdf-eec4-43d6-801b-463f22858c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a616bfdc-5ea0-45e9-82df-3acc011dafff', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2ac11c-2198-45bb-ab4b-7943ac5086fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Volume volume-a616bfdc-5ea0-45e9-82df-3acc011dafff (a616bfdc-5ea0-45e9-82df-3acc011dafff): created successfully Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2ac11c-2198-45bb-ab4b-7943ac5086fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Flow 'volume_create_manager' (749855c8-a838-4b6f-9557-0cff6cebf88f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e372d965-a1a0-4f93-b9aa-a9e2a4c21c82 tempest-VolumesListAdminTestJSON-234640369 None] Created volume successfully. Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Flow 'volume_create_manager' (d27b43e0-0972-47cd-bba2-08f83e9f754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4be7ff8-c81d-41c0-93d0-a878660f6f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4be7ff8-c81d-41c0-93d0-a878660f6f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-785026367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a0dc48-5ece-431c-8545-16f13f9db3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277fb0e139b47d1a0d6684d6365c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:31Z,use_quota=True,user_id='a27ede931eb64a208658288394b38aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bffa207-3771-42a4-ad80-68ef9379c52d),volume_type_id=5bffa207-3771-42a4-ad80-68ef9379c52d)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d62f99-0534-4928-86bf-97924884a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d62f99-0534-4928-86bf-97924884a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3db674-ed5f-46df-b680-e1486945ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3db674-ed5f-46df-b680-e1486945ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a0dc48-5ece-431c-8545-16f13f9db3c9', 'volume_name': 'volume-11a0dc48-5ece-431c-8545-16f13f9db3c9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154998bd-ca71-40eb-b7b3-1ffddb6d64df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154998bd-ca71-40eb-b7b3-1ffddb6d64df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335afad1-bd74-4607-b3f1-b880744a5d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume 11a0dc48-5ece-431c-8545-16f13f9db3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a0dc48-5ece-431c-8545-16f13f9db3c9', 'volume_size': 1} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-785026367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a0dc48-5ece-431c-8545-16f13f9db3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277fb0e139b47d1a0d6684d6365c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:31Z,use_quota=True,user_id='a27ede931eb64a208658288394b38aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bffa207-3771-42a4-ad80-68ef9379c52d),volume_type_id=5bffa207-3771-42a4-ad80-68ef9379c52d)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Creating volume 11a0dc48-5ece-431c-8545-16f13f9db3c9 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:31 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:31 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 1073741824 Nov 06 19:40:31 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:32 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 1073741824" returned: 0 in 0.808s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Flow 'volume_create_manager' (bf593d01-4f9e-4872-864c-fa91ca582865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a434410-607a-4ccd-b99a-86913f794efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:32 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 Nov 06 19:40:32 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a434410-607a-4ccd-b99a-86913f794efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1339872586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8c2983-b356-453f-9cb3-c21199bc0b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277fb0e139b47d1a0d6684d6365c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:32Z,use_quota=True,user_id='a27ede931eb64a208658288394b38aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67f3b443-1f53-41fc-a266-88e5fab90e26),volume_type_id=67f3b443-1f53-41fc-a266-88e5fab90e26)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4aa7bd-8e42-440c-b79c-7881199f7e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4aa7bd-8e42-440c-b79c-7881199f7e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ee8a07-d659-4b40-a167-35680a5f7bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ee8a07-d659-4b40-a167-35680a5f7bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8c2983-b356-453f-9cb3-c21199bc0b42', 'volume_name': 'volume-7c8c2983-b356-453f-9cb3-c21199bc0b42', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5cee26-2a61-4f1b-90d2-6446f636002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5cee26-2a61-4f1b-90d2-6446f636002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efd8002-e7df-4dbe-ae50-6895393e5a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume 7c8c2983-b356-453f-9cb3-c21199bc0b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8c2983-b356-453f-9cb3-c21199bc0b42', 'volume_size': 1} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:32 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9" returned: 0 in 0.311s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1339872586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8c2983-b356-453f-9cb3-c21199bc0b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277fb0e139b47d1a0d6684d6365c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:32Z,use_quota=True,user_id='a27ede931eb64a208658288394b38aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67f3b443-1f53-41fc-a266-88e5fab90e26),volume_type_id=67f3b443-1f53-41fc-a266-88e5fab90e26)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Creating volume 7c8c2983-b356-453f-9cb3-c21199bc0b42 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:32 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335afad1-bd74-4607-b3f1-b880744a5d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a0dc48-5ece-431c-8545-16f13f9db3c9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:32 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 1073741824 Nov 06 19:40:32 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfbd67e-79eb-4dda-a853-411df4919fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 (11a0dc48-5ece-431c-8545-16f13f9db3c9): created successfully Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfbd67e-79eb-4dda-a853-411df4919fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Flow 'volume_create_manager' (d27b43e0-0972-47cd-bba2-08f83e9f754d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-513e0419-c39c-483f-9f41-550819cb35f2 tempest-TestInstancesWithCinderVolumes-342809615 None] Created volume successfully. Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Flow 'volume_create_manager' (3cc7422a-a0e8-424e-8c2f-95803634894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90588ff-d6e7-4e08-aceb-120d6b009e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90588ff-d6e7-4e08-aceb-120d6b009e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1806443918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40597081-7641-44ba-977d-c738afe35e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f5009b1a3472389186bc6b9a6694e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:33Z,use_quota=True,user_id='03b897f31cf7455caa529b6d255d7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4280c0bc-e06b-46ba-860b-09e14ea9a251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4280c0bc-e06b-46ba-860b-09e14ea9a251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6097a6ea-eb4b-4ec7-86b4-8291339f3542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6097a6ea-eb4b-4ec7-86b4-8291339f3542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40597081-7641-44ba-977d-c738afe35e71', 'volume_name': 'volume-40597081-7641-44ba-977d-c738afe35e71', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1472600-9302-41d4-aa8c-b59e80225ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1472600-9302-41d4-aa8c-b59e80225ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0391375b-250e-4cc6-a00b-091bfaf403bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Volume 40597081-7641-44ba-977d-c738afe35e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40597081-7641-44ba-977d-c738afe35e71', 'volume_size': 1} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:33 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 1073741824" returned: 0 in 0.741s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:33 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 Nov 06 19:40:33 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:33 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Flow 'volume_create_manager' (fd5c354d-a9c3-478d-9f40-a34cb64b6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2dd51a-e35b-4289-88da-ef47fff28385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42" returned: 0 in 0.376s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1806443918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40597081-7641-44ba-977d-c738afe35e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1f5009b1a3472389186bc6b9a6694e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:33Z,use_quota=True,user_id='03b897f31cf7455caa529b6d255d7476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Creating volume 40597081-7641-44ba-977d-c738afe35e71 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:33 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2dd51a-e35b-4289-88da-ef47fff28385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1275030693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4971d3-48d3-4cc5-89a4-ba1066c7c991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277fb0e139b47d1a0d6684d6365c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:34Z,use_quota=True,user_id='a27ede931eb64a208658288394b38aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(343d4665-665d-4836-8808-0503d91db2e1),volume_type_id=343d4665-665d-4836-8808-0503d91db2e1)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36f70b0-6af1-4e6a-9951-711b73574a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36f70b0-6af1-4e6a-9951-711b73574a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:33 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 1073741824 Nov 06 19:40:33 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585d35e8-e645-4765-a7a8-62f60fcbe1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9efd8002-e7df-4dbe-ae50-6895393e5a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8c2983-b356-453f-9cb3-c21199bc0b42', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e09c589-bcc6-4808-bda9-14681ac75165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 (7c8c2983-b356-453f-9cb3-c21199bc0b42): created successfully Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e09c589-bcc6-4808-bda9-14681ac75165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Flow 'volume_create_manager' (bf593d01-4f9e-4872-864c-fa91ca582865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:34 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9d728e38-c584-44a1-9a32-31c33ddb8fc6 tempest-TestInstancesWithCinderVolumes-342809615 None] Created volume successfully. Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585d35e8-e645-4765-a7a8-62f60fcbe1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b4971d3-48d3-4cc5-89a4-ba1066c7c991', 'volume_name': 'volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991', 'volume_size': 1, 'image_id': 'f69ab546-a901-4894-80f6-cdce36a8639e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f69ab546-a901-4894-80f6-cdce36a8639e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2111142479', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2277fb0e139b47d1a0d6684d6365c8d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f69ab546-a901-4894-80f6-cdce36a8639e', 'created_at': datetime.datetime(2026, 11, 6, 18, 40, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f69ab546-a901-4894-80f6-cdce36a8639e/file', 'properties': {}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cdc778-52bd-4098-a8e8-04df3739e062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cdc778-52bd-4098-a8e8-04df3739e062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c738b0-9a91-435f-ad7a-078877178126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume 2b4971d3-48d3-4cc5-89a4-ba1066c7c991: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991', 'volume_size': 1, 'image_id': 'f69ab546-a901-4894-80f6-cdce36a8639e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f69ab546-a901-4894-80f6-cdce36a8639e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2111142479', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2277fb0e139b47d1a0d6684d6365c8d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f69ab546-a901-4894-80f6-cdce36a8639e', 'created_at': datetime.datetime(2026, 11, 6, 18, 40, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f69ab546-a901-4894-80f6-cdce36a8639e/file', 'properties': {}}, 'image_service': } Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Trying to clone 2b4971d3-48d3-4cc5-89a4-ba1066c7c991 from image f69ab546-a901-4894-80f6-cdce36a8639e at location (None, [{'url': 'file:///opt/stack/data/glance/images/f69ab546-a901-4894-80f6-cdce36a8639e', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:40:34 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 1073741824" returned: 0 in 0.685s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:34 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 Nov 06 19:40:34 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:35 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71" returned: 0 in 0.421s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0391375b-250e-4cc6-a00b-091bfaf403bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40597081-7641-44ba-977d-c738afe35e71', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f686408-69e6-4a75-937c-8ccd7417ef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Volume volume-40597081-7641-44ba-977d-c738afe35e71 (40597081-7641-44ba-977d-c738afe35e71): created successfully Nov 06 19:40:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f686408-69e6-4a75-937c-8ccd7417ef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Flow 'volume_create_manager' (3cc7422a-a0e8-424e-8c2f-95803634894a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-461c348b-67e5-4ae3-85de-e5786d540210 tempest-VolumesListAdminTestJSON-234640369 None] Created volume successfully. Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Flow 'volume_create_manager' (71873341-f7b5-4315-b3d4-ab23bb944759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e20a5f-2a92-426d-a5bf-c3b4875a75f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e20a5f-2a92-426d-a5bf-c3b4875a75f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd5d48-94b4-4182-940f-c52c78407c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072bb26e0af842b7bcf5b3954b5085d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:37Z,use_quota=True,user_id='a8205a52eb9f42c6bf907ce039c60c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c93b62-e825-4145-a34b-4ff1e321faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c93b62-e825-4145-a34b-4ff1e321faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21045c4-1ebc-4cd1-9fe3-25e760c1426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21045c4-1ebc-4cd1-9fe3-25e760c1426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edd5d48-94b4-4182-940f-c52c78407c9f', 'volume_name': 'volume-2edd5d48-94b4-4182-940f-c52c78407c9f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d20534e-85c6-449f-ac16-9aa7667c9039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d20534e-85c6-449f-ac16-9aa7667c9039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc9a11-f602-414e-afff-ebb44e879763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Volume 2edd5d48-94b4-4182-940f-c52c78407c9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edd5d48-94b4-4182-940f-c52c78407c9f', 'volume_size': 1} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edd5d48-94b4-4182-940f-c52c78407c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072bb26e0af842b7bcf5b3954b5085d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:37Z,use_quota=True,user_id='a8205a52eb9f42c6bf907ce039c60c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Creating volume 2edd5d48-94b4-4182-940f-c52c78407c9f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:37 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:37 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f 1073741824 Nov 06 19:40:37 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:38 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f 1073741824" returned: 0 in 0.804s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:38 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f Nov 06 19:40:38 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:39 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f" returned: 0 in 0.535s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc9a11-f602-414e-afff-ebb44e879763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edd5d48-94b4-4182-940f-c52c78407c9f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751eb1c1-2a47-4eea-a023-64ff7dad8766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:39 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Volume volume-2edd5d48-94b4-4182-940f-c52c78407c9f (2edd5d48-94b4-4182-940f-c52c78407c9f): created successfully Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751eb1c1-2a47-4eea-a023-64ff7dad8766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Flow 'volume_create_manager' (71873341-f7b5-4315-b3d4-ab23bb944759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3e6fe5ef-a7c7-4bb2-adcd-58fdec9ccdd7 tempest-VolumesListAdminTestJSON-406500593 None] Created volume successfully. Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Flow 'volume_create_manager' (8c78853e-6035-4633-8fce-957134041cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff13446-abeb-4cd6-a218-1c5c6710b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff13446-abeb-4cd6-a218-1c5c6710b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-77600116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083a804f-694d-4263-9e0e-d210b768a065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4ff05db8af414e9767449f1e9452a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:39Z,use_quota=True,user_id='5029c07da8b14df782f74aa12fcd4731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810b4553-4605-4cdc-bca7-b7b846af2919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810b4553-4605-4cdc-bca7-b7b846af2919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837d02f8-dc84-4f92-8480-59205b8dd80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837d02f8-dc84-4f92-8480-59205b8dd80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083a804f-694d-4263-9e0e-d210b768a065', 'volume_name': 'volume-083a804f-694d-4263-9e0e-d210b768a065', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc50a63-975e-4a4d-92e3-624a6d1d237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc50a63-975e-4a4d-92e3-624a6d1d237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46350c4e-b4be-40b1-ae74-ebfe3b45b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:39 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Volume 083a804f-694d-4263-9e0e-d210b768a065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083a804f-694d-4263-9e0e-d210b768a065', 'volume_size': 1} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-77600116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083a804f-694d-4263-9e0e-d210b768a065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4ff05db8af414e9767449f1e9452a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:39Z,use_quota=True,user_id='5029c07da8b14df782f74aa12fcd4731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Creating volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:39 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:39 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 1073741824 Nov 06 19:40:39 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Acquiring lock "cinder-2edd5d48-94b4-4182-940f-c52c78407c9f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Lock "cinder-2edd5d48-94b4-4182-940f-c52c78407c9f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Acquiring lock "cinder-quobyte-2edd5d48-94b4-4182-940f-c52c78407c9f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Lock "cinder-quobyte-2edd5d48-94b4-4182-940f-c52c78407c9f" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "cinder-40597081-7641-44ba-977d-c738afe35e71-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-40597081-7641-44ba-977d-c738afe35e71-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7dcba4-55e6-477f-a619-75c7196bce42]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "cinder-quobyte-40597081-7641-44ba-977d-c738afe35e71" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-quobyte-40597081-7641-44ba-977d-c738afe35e71" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:40 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f Nov 06 19:40:40 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf30de9-e554-446d-b478-90aa9a63cc9b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:40 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 Nov 06 19:40:40 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:40 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 1073741824" returned: 0 in 1.013s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:40 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 Nov 06 19:40:40 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:40 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f" returned: 0 in 0.839s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:40 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71" returned: 0 in 0.674s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:40 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f Nov 06 19:40:40 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:40 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71 Nov 06 19:40:40 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:40 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065" returned: 0 in 0.474s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46350c4e-b4be-40b1-ae74-ebfe3b45b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083a804f-694d-4263-9e0e-d210b768a065', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8363b71c-85e1-480c-95c9-9bc42162d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:41 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Volume volume-083a804f-694d-4263-9e0e-d210b768a065 (083a804f-694d-4263-9e0e-d210b768a065): created successfully Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8363b71c-85e1-480c-95c9-9bc42162d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Flow 'volume_create_manager' (8c78853e-6035-4633-8fce-957134041cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:41 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b0fe908c-07df-47b1-987f-3ab961e0cba0 tempest-SnapshotsActionsTest-663389246 None] Created volume successfully. Nov 06 19:40:41 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2edd5d48-94b4-4182-940f-c52c78407c9f" returned: 0 in 0.487s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:41 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-40597081-7641-44ba-977d-c738afe35e71" returned: 0 in 0.477s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Lock "cinder-quobyte-2edd5d48-94b4-4182-940f-c52c78407c9f" released by "delete_volume" :: held 1.446s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-quobyte-40597081-7641-44ba-977d-c738afe35e71" released by "delete_volume" :: held 1.229s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Created reservations ['d0ce2ee9-0e9f-4c70-92ea-02bc2238afb7', 'cd3fd416-cfe2-44cc-9bd5-18e1a0af00fc', '5a2ff66c-e069-4fd2-8b02-8aba69f05112', '4c9837dc-d7aa-48ca-b01c-3562a5bfc72a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Created reservations ['d7838d53-ceda-4f81-9133-08ea05672a54', 'e226ef94-1858-411d-a63b-9d757e811fa0', 'cc2915a1-26f6-4bdb-909d-1079a907dc67', '39b314f0-b383-4d74-b6b7-f14b633cc63e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:41 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:41 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:41 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:41 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Creating offline snapshot 3d141c73-b2f9-4814-aa66-3827b9a5af8e of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d191c07c-07c2-458a-9b66-c62e496bd137]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:42 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.514s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:42 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Deleted volume successfully. Nov 06 19:40:42 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 Nov 06 19:40:42 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD, size 20.69 MB, duration 7.67 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:40:42 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Image download 20.69 MB at 2.70 MB/s Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e906a5f4-9b9c-448b-95ec-ec4c8f7f6b60 tempest-VolumesListAdminTestJSON-406500593 None] Lock "cinder-2edd5d48-94b4-4182-940f-c52c78407c9f-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:42 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.690s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:42 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Deleted volume successfully. Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-68811213-0ab9-4f37-a6c6-62921eae0977 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-40597081-7641-44ba-977d-c738afe35e71-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0522aa-464e-41c6-b12e-bdc930d971e4]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "cinder-a616bfdc-5ea0-45e9-82df-3acc011dafff-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-a616bfdc-5ea0-45e9-82df-3acc011dafff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "cinder-quobyte-a616bfdc-5ea0-45e9-82df-3acc011dafff" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:42 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065" returned: 0 in 0.586s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:42 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD Nov 06 19:40:42 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-quobyte-a616bfdc-5ea0-45e9-82df-3acc011dafff" acquired by "delete_volume" :: waited 0.053s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:42 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e 1G Nov 06 19:40:42 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066a5c7-2740-4b7c-9c16-1bc9e71fcd84]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:42 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff Nov 06 19:40:42 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:42 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD" returned: 0 in 0.616s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:42 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Temporary image f69ab546-a901-4894-80f6-cdce36a8639e is fetched for user a27ede931eb64a208658288394b38aa3. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dc7881-704f-42c5-9693-e49aa346e9f1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:43 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e 1G" returned: 0 in 0.621s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:43 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:40:43 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:43 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD Nov 06 19:40:43 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:43 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff" returned: 0 in 0.674s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:43 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff Nov 06 19:40:43 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:43 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:43 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.381s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:43 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e is being set with open permissions: ugo+rw Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:43 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:40:43 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:43 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a616bfdc-5ea0-45e9-82df-3acc011dafff" returned: 0 in 0.299s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-quobyte-a616bfdc-5ea0-45e9-82df-3acc011dafff" released by "delete_volume" :: held 1.059s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Created reservations ['765e1de5-a35b-46ac-9d48-67c3478cc40d', '4818e11e-326c-40f6-b5b4-e9d65c162a9d', 'eb76b0b9-c01d-466b-9150-384fd0bcdbe7', '1eb0f0f1-0e18-4bc2-9aaf-67bc164cfe09'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:43 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:43 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:43 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.305s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:43 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.info Nov 06 19:40:43 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:44 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.278s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Deleted volume successfully. Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7032b77d-6c92-4fa4-b269-635559fb6262 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-a616bfdc-5ea0-45e9-82df-3acc011dafff-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:44 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.info" returned: 0 in 0.283s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:44 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.info is being set with open permissions: ugo+rw Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:44 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.info Nov 06 19:40:44 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:44 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.info" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1275030693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4971d3-48d3-4cc5-89a4-ba1066c7c991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2277fb0e139b47d1a0d6684d6365c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:34Z,use_quota=True,user_id='a27ede931eb64a208658288394b38aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(343d4665-665d-4836-8808-0503d91db2e1),volume_type_id=343d4665-665d-4836-8808-0503d91db2e1)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Creating volume 2b4971d3-48d3-4cc5-89a4-ba1066c7c991 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:44 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:44 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 1073741824 Nov 06 19:40:44 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8df267e4-a594-4278-8cfc-5c3371f1110f tempest-SnapshotsActionsTest-663389246 None] Create snapshot completed successfully Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "cinder-668267e2-9fff-416f-a5ae-31540e656f50-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-668267e2-9fff-416f-a5ae-31540e656f50-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "cinder-quobyte-668267e2-9fff-416f-a5ae-31540e656f50" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-quobyte-668267e2-9fff-416f-a5ae-31540e656f50" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb28441c-72ee-4da3-8666-5ebb949cc1ac]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:45 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 1073741824" returned: 0 in 0.541s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:45 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 Nov 06 19:40:45 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:45 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 Nov 06 19:40:45 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:45 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50" returned: 0 in 0.481s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:45 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:45 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50 Nov 06 19:40:45 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Attempting download of f69ab546-a901-4894-80f6-cdce36a8639e ((None, [{'url': 'file:///opt/stack/data/glance/images/f69ab546-a901-4894-80f6-cdce36a8639e', 'metadata': {}}])) to volume 2b4971d3-48d3-4cc5-89a4-ba1066c7c991. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0bac2c-a744-4f6a-8bc5-463b966c77ba]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f69ab546-a901-4894-80f6-cdce36a8639e_5w0dxe5x {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Creating offline snapshot 231f3065-e5be-4d0c-884e-705ff01cf3e9 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:40:45 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f69ab546-a901-4894-80f6-cdce36a8639e_5w0dxe5x Nov 06 19:40:45 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adad6b7-0814-4549-af72-ee8103a290af]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:45 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-668267e2-9fff-416f-a5ae-31540e656f50" returned: 0 in 0.341s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-quobyte-668267e2-9fff-416f-a5ae-31540e656f50" released by "delete_volume" :: held 0.886s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Created reservations ['23eddd86-8ddb-4bc0-b2d0-bb9ade63dffb', 'e56761be-5f97-4b33-ac4f-651350ab23c3', '0dcec382-9329-4710-9ce7-a5fabcaa1e5a', 'a25ae511-3412-46f5-b4fa-d49d627e570e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:45 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:40:45 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:46 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f69ab546-a901-4894-80f6-cdce36a8639e_5w0dxe5x" returned: 0 in 0.551s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f69ab546-a901-4894-80f6-cdce36a8639e_5w0dxe5x {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:46 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:46 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:46 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.586s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:46 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f69ab546-a901-4894-80f6-cdce36a8639e_5w0dxe5x Nov 06 19:40:46 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:46 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 1G Nov 06 19:40:46 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:46 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.375s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Deleted volume successfully. Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3dba2505-bc13-4d08-a2e5-e21d7c700c64 tempest-VolumesListAdminTestJSON-234640369 None] Lock "cinder-668267e2-9fff-416f-a5ae-31540e656f50-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:46 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f69ab546-a901-4894-80f6-cdce36a8639e_5w0dxe5x" returned: 1 in 0.472s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f69ab546-a901-4894-80f6-cdce36a8639e_5w0dxe5x' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8d1fd0-7271-4d32-a517-8185074aed3e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:46 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD Nov 06 19:40:46 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:47 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 1G" returned: 0 in 0.681s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:47 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 Nov 06 19:40:47 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:47 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] f69ab546-a901-4894-80f6-cdce36a8639e was qcow2, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:47 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 Nov 06 19:40:47 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:47 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:40:47 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:47 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9" returned: 0 in 0.452s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:47 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 is being set with open permissions: ugo+rw Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:47 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.354s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:40:47 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 Nov 06 19:40:47 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:47 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9" returned: 0 in 0.329s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c44153ad-793f-415c-a246-8eda56c6f3b8 tempest-SnapshotsActionsTest-663389246 None] Create snapshot completed successfully Nov 06 19:40:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-231f3065-e5be-4d0c-884e-705ff01cf3e9-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-231f3065-e5be-4d0c-884e-705ff01cf3e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-231f3065-e5be-4d0c-884e-705ff01cf3e9" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-231f3065-e5be-4d0c-884e-705ff01cf3e9" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Deleting offline snapshot 231f3065-e5be-4d0c-884e-705ff01cf3e9 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] snapshot_file for this snap is: volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b41874-038c-4042-9547-82c0ff2fdefb]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:49 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 Nov 06 19:40:49 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:49 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991" returned: 0 in 2.481s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f69ab546-a901-4894-80f6-cdce36a8639e_2lrzf_exdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:40:49 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Converted 112.00 MB image at 45.13 MB/s Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:49 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 1G Nov 06 19:40:49 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:49 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9" returned: 0 in 0.565s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ca4da-3905-4f2f-be10-b94e728e3b32]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:49 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:40:49 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:49 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 1G" returned: 0 in 0.409s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Downloaded image f69ab546-a901-4894-80f6-cdce36a8639e ((None, [{'url': 'file:///opt/stack/data/glance/images/f69ab546-a901-4894-80f6-cdce36a8639e', 'metadata': {}}])) to volume 2b4971d3-48d3-4cc5-89a4-ba1066c7c991 successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Temporary image f69ab546-a901-4894-80f6-cdce36a8639e for user a27ede931eb64a208658288394b38aa3 is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Marking volume 2b4971d3-48d3-4cc5-89a4-ba1066c7c991 as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Copying metadata from image f69ab546-a901-4894-80f6-cdce36a8639e to 2b4971d3-48d3-4cc5-89a4-ba1066c7c991. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Creating volume glance metadata for volume 2b4971d3-48d3-4cc5-89a4-ba1066c7c991 backed by image f69ab546-a901-4894-80f6-cdce36a8639e with: {'image_id': 'f69ab546-a901-4894-80f6-cdce36a8639e', 'image_name': 'tempest-scenario-img--2111142479', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c738b0-9a91-435f-ad7a-078877178126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991', 'volume_size': 1, 'image_id': 'f69ab546-a901-4894-80f6-cdce36a8639e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f69ab546-a901-4894-80f6-cdce36a8639e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2111142479', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2277fb0e139b47d1a0d6684d6365c8d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f69ab546-a901-4894-80f6-cdce36a8639e', 'created_at': datetime.datetime(2026, 11, 6, 18, 40, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 40, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f69ab546-a901-4894-80f6-cdce36a8639e/file', 'properties': {}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c98ed3-59ea-4231-ab30-12eddbbf3149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Volume volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 (2b4971d3-48d3-4cc5-89a4-ba1066c7c991): created successfully Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c98ed3-59ea-4231-ab30-12eddbbf3149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Flow 'volume_create_manager' (fd5c354d-a9c3-478d-9f40-a34cb64b6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-32e7fa90-9739-4fb8-bd66-4afbe02702c1 tempest-TestInstancesWithCinderVolumes-342809615 None] Created volume successfully. Nov 06 19:40:50 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.462s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:50 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 Nov 06 19:40:50 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:50 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9" returned: 0 in 0.424s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:50 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9 Nov 06 19:40:50 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:50 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.231f3065-e5be-4d0c-884e-705ff01cf3e9" returned: 0 in 0.280s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-231f3065-e5be-4d0c-884e-705ff01cf3e9" released by "_delete_snapshot" :: held 1.864s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" released by "delete_snapshot" :: held 1.906s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:51 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Created reservations ['4defa36e-2be4-41f5-b555-20bd4167c11f', '954302a5-7d8a-43f0-9658-5ec4b1f810bf', 'eca29407-4ed0-49a9-a54c-94581e5034dd', '18542a47-d6a5-489c-b93e-0dd732ca829f'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Delete snapshot completed successfully. Nov 06 19:40:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-26376799-6f1e-4cc6-a047-9a9062d2d42d tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-231f3065-e5be-4d0c-884e-705ff01cf3e9-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Creating offline snapshot e60df85a-c8da-4790-9cb0-9e33bf7a89e2 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:40:51 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79a1a6-3ed9-4964-a1b2-b8d6679b7607]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:51 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:40:51 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:52 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.457s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:52 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 1G Nov 06 19:40:52 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:52 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 1G" returned: 0 in 0.560s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:52 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 Nov 06 19:40:52 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:52 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:40:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Flow 'volume_create_manager' (0b2b394e-cf16-4d5f-8f7b-4784097b6076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4824ea-e45c-488c-874f-0a086108f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4824ea-e45c-488c-874f-0a086108f671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1500160326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7792d06-b351-4e0b-8a6c-e49dab011641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668b56794add473a967c664a59a12fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:53Z,use_quota=True,user_id='cf95d128a9ab4013b980a60acd529f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d6f41b-5593-43af-a37f-1a3bfca63acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d6f41b-5593-43af-a37f-1a3bfca63acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a3067e-1ebc-473a-9d19-4c5189a1370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:40:53 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2" returned: 0 in 0.466s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:53 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 is being set with open permissions: ugo+rw Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:53 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 Nov 06 19:40:53 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a3067e-1ebc-473a-9d19-4c5189a1370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7792d06-b351-4e0b-8a6c-e49dab011641', 'volume_name': 'volume-e7792d06-b351-4e0b-8a6c-e49dab011641', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3141d1-4f25-40e2-aace-a7c1357f1a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3141d1-4f25-40e2-aace-a7c1357f1a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fd43d6-5b22-4b36-8e57-99b0db6fd2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:40:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Volume e7792d06-b351-4e0b-8a6c-e49dab011641: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7792d06-b351-4e0b-8a6c-e49dab011641', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Trying to clone e7792d06-b351-4e0b-8a6c-e49dab011641 from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:40:53 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-35d0b1a0-f09f-4cba-a779-42c074edd380 req-c7bb7c6a-f3d4-456b-9e34-83d3e56ffe47 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2" returned: 0 in 0.307s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-35d0b1a0-f09f-4cba-a779-42c074edd380 req-c7bb7c6a-f3d4-456b-9e34-83d3e56ffe47 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.043s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-35d0b1a0-f09f-4cba-a779-42c074edd380 req-c7bb7c6a-f3d4-456b-9e34-83d3e56ffe47 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-650906d0-4a06-4cb7-a54d-f2c2d344a0aa tempest-SnapshotsActionsTest-663389246 None] Create snapshot completed successfully Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-35d0b1a0-f09f-4cba-a779-42c074edd380 req-c7bb7c6a-f3d4-456b-9e34-83d3e56ffe47 tempest-TestInstancesWithCinderVolumes-342809615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35a617a2-c952-461a-997e-2f47c76d5c3f', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:40:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-35d0b1a0-f09f-4cba-a779-42c074edd380 req-c7bb7c6a-f3d4-456b-9e34-83d3e56ffe47 tempest-TestInstancesWithCinderVolumes-342809615 None] attachment_update completed successfully. Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-e60df85a-c8da-4790-9cb0-9e33bf7a89e2-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-e60df85a-c8da-4790-9cb0-9e33bf7a89e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-e60df85a-c8da-4790-9cb0-9e33bf7a89e2" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-e60df85a-c8da-4790-9cb0-9e33bf7a89e2" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:40:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Deleting offline snapshot e60df85a-c8da-4790-9cb0-9e33bf7a89e2 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] snapshot_file for this snap is: volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:40:54 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Image download 20.69 MB at 20.69 MB/s Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae8ba38-f662-4e7c-9e8d-fa502d5f53f9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[75928b3b-30c2-48af-9309-4f75f7b306a5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:54 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 Nov 06 19:40:54 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:54 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD Nov 06 19:40:54 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:54 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2" returned: 0 in 0.431s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6d54b0-66a4-4df8-b821-15e474bb8c70]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:54 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 is fetched for user cf95d128a9ab4013b980a60acd529f31. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:40:54 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:40:54 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c8700-bc60-4642-a643-6b9afed33f96]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:54 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD Nov 06 19:40:54 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:54 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.429s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:54 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 Nov 06 19:40:54 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:55 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1500160326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7792d06-b351-4e0b-8a6c-e49dab011641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668b56794add473a967c664a59a12fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:40:53Z,use_quota=True,user_id='cf95d128a9ab4013b980a60acd529f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Creating volume e7792d06-b351-4e0b-8a6c-e49dab011641 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:40:55 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:55 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 1073741824 Nov 06 19:40:55 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:55 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2" returned: 0 in 0.459s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:55 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2 Nov 06 19:40:55 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:55 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 1073741824" returned: 0 in 0.554s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:55 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 Nov 06 19:40:55 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:55 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.e60df85a-c8da-4790-9cb0-9e33bf7a89e2" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-e60df85a-c8da-4790-9cb0-9e33bf7a89e2" released by "_delete_snapshot" :: held 1.788s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" released by "delete_snapshot" :: held 1.874s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Created reservations ['8163baa1-4bbc-460b-897b-8f809e5dae30', 'b59c699c-e279-4b0b-a42f-f07765db80c5', '05fa0eab-018b-4672-9c19-753998a33778', '6f9434c3-8dd5-43dc-8fd3-a9e5ffeb4d92'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:40:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Delete snapshot completed successfully. Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e1fa3e47-dc79-479a-94d1-4ba3e97f65c2 tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-e60df85a-c8da-4790-9cb0-9e33bf7a89e2-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:40:55 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641" returned: 0 in 0.313s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:55 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Attempting download of 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume e7792d06-b351-4e0b-8a6c-e49dab011641. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b30f1fb-a35f-4abb-b292-5e9001241261]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_6xc_h3oe {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:56 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_6xc_h3oe Nov 06 19:40:56 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:56 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_6xc_h3oe" returned: 0 in 0.388s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_6xc_h3oe {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:56 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_6xc_h3oe Nov 06 19:40:56 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Creating offline snapshot ed1ed05c-9f29-45ab-986b-70b50608aa59 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[01549414-0707-465c-bc3b-5bc2df4e2bba]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:57 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_6xc_h3oe" returned: 1 in 0.681s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_6xc_h3oe' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[078426b8-6330-4d97-a407-334958152621]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:57 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:40:57 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:57 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD Nov 06 19:40:57 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:57 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.741s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:57 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 1G Nov 06 19:40:57 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:57 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD" returned: 0 in 0.671s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] 1ceb92fc-a0e0-406c-96f4-c36f37d42275 was qcow2, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:40:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:57 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 Nov 06 19:40:57 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:58 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 1G" returned: 0 in 0.641s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:58 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 Nov 06 19:40:58 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:59 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59" returned: 0 in 0.651s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:59 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 is being set with open permissions: ugo+rw Nov 06 19:40:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:40:59 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 Nov 06 19:40:59 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:40:59 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Nov 06 19:40:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59" returned: 0 in 0.528s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:40:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.889s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:40:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7ea28243-c878-4efc-8c9d-12c617c97064 tempest-SnapshotsActionsTest-663389246 None] Create snapshot completed successfully Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-ed1ed05c-9f29-45ab-986b-70b50608aa59-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-ed1ed05c-9f29-45ab-986b-70b50608aa59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-ed1ed05c-9f29-45ab-986b-70b50608aa59" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-ed1ed05c-9f29-45ab-986b-70b50608aa59" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Deleting offline snapshot ed1ed05c-9f29-45ab-986b-70b50608aa59 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] snapshot_file for this snap is: volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca02f7-06c9-47f1-b2b9-864a63ea729d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:00 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 Nov 06 19:41:00 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:00 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641" returned: 0 in 2.956s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_91zv0j1gdevstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:41:00 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Converted 112.00 MB image at 37.86 MB/s Nov 06 19:41:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:00 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 1G Nov 06 19:41:00 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:01 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59" returned: 0 in 0.733s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f64f9-ed7c-471e-8026-9d9b3c618e46]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:01 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 1G" returned: 0 in 0.619s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Downloaded image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume e7792d06-b351-4e0b-8a6c-e49dab011641 successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:41:01 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:41:01 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 for user cf95d128a9ab4013b980a60acd529f31 is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Marking volume e7792d06-b351-4e0b-8a6c-e49dab011641 as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Copying metadata from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 to e7792d06-b351-4e0b-8a6c-e49dab011641. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Creating volume glance metadata for volume e7792d06-b351-4e0b-8a6c-e49dab011641 backed by image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Flow 'volume_create_manager' (795aaa95-e54c-4cf4-b190-362bd8eb6bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fffd409-95ee-40b4-98fc-d8a95877c296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fffd409-95ee-40b4-98fc-d8a95877c296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1949561296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7844330f7bf466480caaac1b1d86c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:02Z,use_quota=True,user_id='9750a471c235405b83e1629dbdc28e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9dfb90-591c-4ef0-8f15-46fe7446cc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9dfb90-591c-4ef0-8f15-46fe7446cc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e8d645-b242-4916-bb40-434796c3bf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e8d645-b242-4916-bb40-434796c3bf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc', 'volume_name': 'volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2af7026-5429-4eab-83c9-617f9f9a3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2af7026-5429-4eab-83c9-617f9f9a3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfe3ba2-c0ee-4d2a-a424-f00ae327654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:01 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Volume 798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc', 'volume_size': 1} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1949561296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7844330f7bf466480caaac1b1d86c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:02Z,use_quota=True,user_id='9750a471c235405b83e1629dbdc28e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Creating volume 798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:41:01 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:01 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc 1073741824 Nov 06 19:41:01 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fd43d6-5b22-4b36-8e57-99b0db6fd2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7792d06-b351-4e0b-8a6c-e49dab011641', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513509f4-6220-4377-82c0-47085c8107ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:01 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.773s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:41:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:02 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Volume volume-e7792d06-b351-4e0b-8a6c-e49dab011641 (e7792d06-b351-4e0b-8a6c-e49dab011641): created successfully Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513509f4-6220-4377-82c0-47085c8107ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Flow 'volume_create_manager' (0b2b394e-cf16-4d5f-8f7b-4784097b6076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aba103bb-cc34-4bf6-8bea-8b48c3c7749f tempest-VolumesImageMetadata-651962775 None] Created volume successfully. Nov 06 19:41:02 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 Nov 06 19:41:02 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:02 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc 1073741824" returned: 0 in 0.612s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:02 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc Nov 06 19:41:02 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:02 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59" returned: 0 in 0.690s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:02 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59 Nov 06 19:41:02 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:02 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc" returned: 0 in 0.327s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfe3ba2-c0ee-4d2a-a424-f00ae327654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78f236a-53e3-411a-ae46-e93cb602f94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:02 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Volume volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc (798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc): created successfully Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78f236a-53e3-411a-ae46-e93cb602f94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Flow 'volume_create_manager' (795aaa95-e54c-4cf4-b190-362bd8eb6bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-47559301-20d4-4c58-a774-aa5ebdcc6980 tempest-AttachVolumeNegativeTest-2114870787 None] Created volume successfully. Nov 06 19:41:03 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.ed1ed05c-9f29-45ab-986b-70b50608aa59" returned: 0 in 0.371s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-ed1ed05c-9f29-45ab-986b-70b50608aa59" released by "_delete_snapshot" :: held 2.768s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" released by "delete_snapshot" :: held 2.812s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Created reservations ['0acca766-2aa6-4e85-9424-0f1eb9183d1c', 'd0c9d557-bd29-4525-8d75-c76b1b09ad16', 'b34152e8-d586-4f6b-b7f5-d669d239c72f', '7749c66a-3b15-4d28-a411-329cba6eadcc'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Delete snapshot completed successfully. Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a39231c-a666-42bb-bf0d-ccbdda2ecd4e tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-ed1ed05c-9f29-45ab-986b-70b50608aa59-delete_snapshot" released by "delete_snapshot" :: held 3.107s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Acquiring lock "cinder-e7792d06-b351-4e0b-8a6c-e49dab011641-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Lock "cinder-e7792d06-b351-4e0b-8a6c-e49dab011641-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Acquiring lock "cinder-quobyte-e7792d06-b351-4e0b-8a6c-e49dab011641" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Lock "cinder-quobyte-e7792d06-b351-4e0b-8a6c-e49dab011641" acquired by "delete_volume" :: waited 0.057s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bcdfbf-1a4b-4e17-8152-42fc850fb556]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Creating offline snapshot 12fe0998-54d7-408d-bea8-31c39dbbaea5 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:41:04 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 Nov 06 19:41:04 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a37e662-8fab-4377-b620-6576e7023d59]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:04 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:41:04 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:05 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641" returned: 0 in 1.017s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:05 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641 Nov 06 19:41:05 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:05 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.888s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:05 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 1G Nov 06 19:41:05 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-327b1626-b8ea-49db-982a-bad71b62410a req-0297444f-289b-49e7-9d2e-1cafcebd85ea tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:05 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e7792d06-b351-4e0b-8a6c-e49dab011641" returned: 0 in 0.445s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Lock "cinder-quobyte-e7792d06-b351-4e0b-8a6c-e49dab011641" released by "delete_volume" :: held 1.575s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Created reservations ['fefeb2c4-8b70-4906-a219-74ca92a947f9', '5fd57ec5-3e16-473f-9549-069e55befa4c', '13e1caf3-b035-43aa-a7df-07f38e9b0b10', 'c0548ace-c835-473c-9fc1-e19704888862'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:05 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:41:05 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:06 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 1G" returned: 0 in 0.641s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:06 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 Nov 06 19:41:06 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:06 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.356s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:41:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Deleted volume successfully. Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c40947e8-f88d-4467-a089-0fd1590849d5 tempest-VolumesImageMetadata-651962775 None] Lock "cinder-e7792d06-b351-4e0b-8a6c-e49dab011641-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:06 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:06 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 is being set with open permissions: ugo+rw Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:06 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 Nov 06 19:41:06 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:06 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5" returned: 0 in 0.363s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-327b1626-b8ea-49db-982a-bad71b62410a req-0297444f-289b-49e7-9d2e-1cafcebd85ea tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.366s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-327b1626-b8ea-49db-982a-bad71b62410a req-0297444f-289b-49e7-9d2e-1cafcebd85ea tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-18846235-83ce-45a4-b1ed-458073e6c847 tempest-SnapshotsActionsTest-663389246 None] Create snapshot completed successfully Nov 06 19:41:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-327b1626-b8ea-49db-982a-bad71b62410a req-0297444f-289b-49e7-9d2e-1cafcebd85ea tempest-AttachVolumeNegativeTest-2114870787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ed38434-fe65-4d07-a8f6-a71d8e410e7c', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:41:07 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-327b1626-b8ea-49db-982a-bad71b62410a req-0297444f-289b-49e7-9d2e-1cafcebd85ea tempest-AttachVolumeNegativeTest-2114870787 None] attachment_update completed successfully. Nov 06 19:41:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-12fe0998-54d7-408d-bea8-31c39dbbaea5-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-12fe0998-54d7-408d-bea8-31c39dbbaea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Acquiring lock "cinder-quobyte-12fe0998-54d7-408d-bea8-31c39dbbaea5" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-12fe0998-54d7-408d-bea8-31c39dbbaea5" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Deleting offline snapshot 12fe0998-54d7-408d-bea8-31c39dbbaea5 of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:41:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] snapshot_file for this snap is: volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:41:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7844def7-2a34-4d05-a03c-de7562a56d74]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:08 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 Nov 06 19:41:08 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:08 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5" returned: 0 in 0.617s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:41:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e23245-8fc6-4b22-9299-c6c7488cd494]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:08 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:41:08 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:09 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.647s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:41:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:09 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 Nov 06 19:41:09 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:09 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-b6d8a1d8-559e-49a4-8d43-57cee7c81957 req-4f970d44-207b-41c9-969f-ed99e94040b6 tempest-AttachVolumeNegativeTest-2114870787 None] Terminate volume connection completed successfully. Nov 06 19:41:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-b6d8a1d8-559e-49a4-8d43-57cee7c81957 req-4f970d44-207b-41c9-969f-ed99e94040b6 tempest-AttachVolumeNegativeTest-2114870787 None] Deleting attachment 6ed38434-fe65-4d07-a8f6-a71d8e410e7c. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:41:10 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5" returned: 0 in 0.728s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:10 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5 Nov 06 19:41:10 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:10 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.12fe0998-54d7-408d-bea8-31c39dbbaea5" returned: 0 in 0.636s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-12fe0998-54d7-408d-bea8-31c39dbbaea5" released by "_delete_snapshot" :: held 2.797s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" released by "delete_snapshot" :: held 2.856s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:11 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Created reservations ['3d4b20f8-b8e1-4670-a081-2219ceb49078', 'f907d9ea-90bd-43a2-8165-0c4da5716ab0', 'c5df99f7-d251-476b-be2d-a2a113654c62', '1b49915c-5137-4108-9d98-e807e1b698f4'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Delete snapshot completed successfully. Nov 06 19:41:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-305755ae-adff-458c-a7da-a2e8d74f918c tempest-SnapshotsActionsTest-2012524021 None] Lock "cinder-12fe0998-54d7-408d-bea8-31c39dbbaea5-delete_snapshot" released by "delete_snapshot" :: held 3.342s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "cinder-3d141c73-b2f9-4814-aa66-3827b9a5af8e-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-3d141c73-b2f9-4814-aa66-3827b9a5af8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "cinder-quobyte-3d141c73-b2f9-4814-aa66-3827b9a5af8e" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-quobyte-3d141c73-b2f9-4814-aa66-3827b9a5af8e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Deleting offline snapshot 3d141c73-b2f9-4814-aa66-3827b9a5af8e of volume 083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] snapshot_file for this snap is: volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[62edf33e-7e9f-4541-8eab-aca1d73ff977]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:13 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:41:13 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:13 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.446s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a804f-694d-4263-9e0e-d210b768a065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[521d10bb-3a8f-4561-b526-2d914b3d6e3b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:14 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 Nov 06 19:41:14 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:14 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065" returned: 0 in 0.621s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:14 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:41:14 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:15 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.572s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:15 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e Nov 06 19:41:15 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:15 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065.3d141c73-b2f9-4814-aa66-3827b9a5af8e" returned: 0 in 0.446s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-quobyte-3d141c73-b2f9-4814-aa66-3827b9a5af8e" released by "_delete_snapshot" :: held 2.235s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" released by "delete_snapshot" :: held 2.258s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:15 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Created reservations ['f63ea62e-5dc0-4c4d-b656-5a6f19618ace', 'c820f6fe-9b17-4e34-885a-548ea0785ea4', '864ebba7-e0f9-426c-a1a2-5a342686d989', '3d19b988-e9fa-46ee-8fdf-611373efa6a6'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:15 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Delete snapshot completed successfully. Nov 06 19:41:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-660ca9e7-5d52-4631-a216-e9fb33d5a07e tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-3d141c73-b2f9-4814-aa66-3827b9a5af8e-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "cinder-083a804f-694d-4263-9e0e-d210b768a065-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-083a804f-694d-4263-9e0e-d210b768a065-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:16 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d71d557-c211-4635-acd9-5c2f95dfed13]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:17 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 Nov 06 19:41:17 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:17 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065" returned: 0 in 0.560s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:17 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065 Nov 06 19:41:17 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:17 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-083a804f-694d-4263-9e0e-d210b768a065" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-quobyte-083a804f-694d-4263-9e0e-d210b768a065" released by "delete_volume" :: held 0.982s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:17 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Created reservations ['4e7f4b87-7009-45e0-801b-ff7382a9e628', '0cd3487d-bdd4-44eb-ac7f-4afece9ef726', 'daa1135f-3580-4462-bc64-15ce638ba116', 'd4a7f8cd-656c-413d-921a-347f7a4aa3bc'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:18 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:41:18 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:18 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.259s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:41:18 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Deleted volume successfully. Nov 06 19:41:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7ad2dce5-8df0-4840-8c62-84e6672ccfa1 tempest-SnapshotsActionsTest-663389246 None] Lock "cinder-083a804f-694d-4263-9e0e-d210b768a065-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=146,cinder:SELECT=135,cinder:INSERT=43,cinder:DELETE=8 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=139,cinder:SELECT=131,cinder:INSERT=44,cinder:DELETE=13 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Flow 'volume_create_manager' (412c5699-feac-4f64-bb8a-312bbd5d96ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac3ab2b-16c8-4a3a-95d1-80cf10942755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac3ab2b-16c8-4a3a-95d1-80cf10942755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-828191766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b645a963-e354-4bff-a9ea-8c94ccc1cf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8db0f1b556c4088982c00d5ba59951a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:28Z,use_quota=True,user_id='6e536f362bfc4f06a9c38777ff3ff11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787d6103-4669-413c-b5ea-ba8a72df7399),volume_type_id=787d6103-4669-413c-b5ea-ba8a72df7399)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951189c2-56f3-49bd-bc53-4dca85f071a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951189c2-56f3-49bd-bc53-4dca85f071a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5935f413-7f66-4f4f-8ee6-fe49df2a0ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5935f413-7f66-4f4f-8ee6-fe49df2a0ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b645a963-e354-4bff-a9ea-8c94ccc1cf07', 'volume_name': 'volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeaf9309-4232-43e6-9836-2a55f07bb405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeaf9309-4232-43e6-9836-2a55f07bb405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447703e2-b4b5-4a98-8755-877bd58c42ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:27 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Volume b645a963-e354-4bff-a9ea-8c94ccc1cf07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07', 'volume_size': 1} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-828191766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b645a963-e354-4bff-a9ea-8c94ccc1cf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8db0f1b556c4088982c00d5ba59951a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:28Z,use_quota=True,user_id='6e536f362bfc4f06a9c38777ff3ff11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787d6103-4669-413c-b5ea-ba8a72df7399),volume_type_id=787d6103-4669-413c-b5ea-ba8a72df7399)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Creating volume b645a963-e354-4bff-a9ea-8c94ccc1cf07 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:41:27 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:41:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:28 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 1073741824 Nov 06 19:41:28 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:28 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 1073741824" returned: 0 in 0.962s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:29 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 Nov 06 19:41:29 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:29 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07" returned: 0 in 0.322s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:41:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447703e2-b4b5-4a98-8755-877bd58c42ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434fb8b2-74da-486e-9b53-bcd00e100fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:29 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Volume volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 (b645a963-e354-4bff-a9ea-8c94ccc1cf07): created successfully Nov 06 19:41:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434fb8b2-74da-486e-9b53-bcd00e100fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Flow 'volume_create_manager' (412c5699-feac-4f64-bb8a-312bbd5d96ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-875da6de-82e0-4e3f-be29-fad3750c3d8d tempest-VolumeTypesAccessTest-1135880856 None] Created volume successfully. Nov 06 19:41:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Acquiring lock "cinder-b645a963-e354-4bff-a9ea-8c94ccc1cf07-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Lock "cinder-b645a963-e354-4bff-a9ea-8c94ccc1cf07-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Acquiring lock "cinder-quobyte-b645a963-e354-4bff-a9ea-8c94ccc1cf07" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Lock "cinder-quobyte-b645a963-e354-4bff-a9ea-8c94ccc1cf07" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:30 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[19575bda-2d02-42d9-b97d-73b3066c91c0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:30 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 Nov 06 19:41:30 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:31 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07" returned: 0 in 0.706s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:31 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07 Nov 06 19:41:31 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:31 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b645a963-e354-4bff-a9ea-8c94ccc1cf07" returned: 0 in 0.574s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Lock "cinder-quobyte-b645a963-e354-4bff-a9ea-8c94ccc1cf07" released by "delete_volume" :: held 1.441s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-e48f8d95-d9ad-44a0-8b7c-c48ed55374b6 req-38ff9903-d32f-45da-9783-4dc7b8c8c9e5 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-e48f8d95-d9ad-44a0-8b7c-c48ed55374b6 req-38ff9903-d32f-45da-9783-4dc7b8c8c9e5 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-e48f8d95-d9ad-44a0-8b7c-c48ed55374b6 req-38ff9903-d32f-45da-9783-4dc7b8c8c9e5 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:32 devstack cinder-volume[86928]: WARNING cinder.quota [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1052109524 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1052109524, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:41:32 devstack cinder-volume[86928]: WARNING cinder.quota [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1052109524 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1052109524, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Created reservations ['745cb175-29c7-4a94-a2bd-1028e8613afc', '4b403ad7-64eb-4840-9ae6-7f438e03a25f', '5915167d-b5c7-4760-8cc0-c19206ef8555', 'eaa05789-197b-4066-a96e-c5d91b745ad5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-e48f8d95-d9ad-44a0-8b7c-c48ed55374b6 req-38ff9903-d32f-45da-9783-4dc7b8c8c9e5 tempest-TestInstancesWithCinderVolumes-342809615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-11a0dc48-5ece-431c-8545-16f13f9db3c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73fa7e96-65f5-4f82-a73e-4e96160b5347', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:41:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-e48f8d95-d9ad-44a0-8b7c-c48ed55374b6 req-38ff9903-d32f-45da-9783-4dc7b8c8c9e5 tempest-TestInstancesWithCinderVolumes-342809615 None] attachment_update completed successfully. Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:32 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:41:32 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:41:32 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Flow 'volume_create_manager' (9c49b4bf-e46f-4c0f-8e21-603599da474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3167f3-da53-40d0-91ee-fe9be8ad2306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.346s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3167f3-da53-40d0-91ee-fe9be8ad2306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134754925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff158cd6-827a-49c7-8783-90d765d8c90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100d6d874f714c49854274c720d974b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:32Z,use_quota=True,user_id='43a01048dcfe431996c50da770646cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438dd2df-5063-46b3-b46c-a8d2b8dd6b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438dd2df-5063-46b3-b46c-a8d2b8dd6b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914fa7d0-65a8-4681-8a9c-1bcdbaa3bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914fa7d0-65a8-4681-8a9c-1bcdbaa3bff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff158cd6-827a-49c7-8783-90d765d8c90d', 'volume_name': 'volume-ff158cd6-827a-49c7-8783-90d765d8c90d', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d8a5c2-829a-4610-ae36-34c601741d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d8a5c2-829a-4610-ae36-34c601741d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf5cbbd-995f-4409-897d-f6b13d9e8de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Volume ff158cd6-827a-49c7-8783-90d765d8c90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff158cd6-827a-49c7-8783-90d765d8c90d', 'volume_size': 1} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134754925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff158cd6-827a-49c7-8783-90d765d8c90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100d6d874f714c49854274c720d974b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:32Z,use_quota=True,user_id='43a01048dcfe431996c50da770646cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Creating volume ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:41:32 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Deleted volume successfully. Nov 06 19:41:32 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d 1073741824 Nov 06 19:41:32 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-80de8504-86cf-4f4c-8936-1d85fc91eeda tempest-VolumeTypesAccessTest-1135880856 None] Lock "cinder-b645a963-e354-4bff-a9ea-8c94ccc1cf07-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:33 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d 1073741824" returned: 0 in 0.674s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:33 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:41:33 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:33 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.280s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf5cbbd-995f-4409-897d-f6b13d9e8de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff158cd6-827a-49c7-8783-90d765d8c90d', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38e13a8-0242-4457-8a0f-746e08769f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Volume volume-ff158cd6-827a-49c7-8783-90d765d8c90d (ff158cd6-827a-49c7-8783-90d765d8c90d): created successfully Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38e13a8-0242-4457-8a0f-746e08769f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Flow 'volume_create_manager' (9c49b4bf-e46f-4c0f-8e21-603599da474a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e3e95249-86d3-4e71-b8bd-170d83a438b9 tempest-VolumesActionsTest-69529423 None] Created volume successfully. Nov 06 19:41:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-7418b8ea-9763-4e93-920e-9b75066ebb9a req-c559e42b-112e-49be-a8e8-216036f3ab2b tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-7418b8ea-9763-4e93-920e-9b75066ebb9a req-c559e42b-112e-49be-a8e8-216036f3ab2b tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-7418b8ea-9763-4e93-920e-9b75066ebb9a req-c559e42b-112e-49be-a8e8-216036f3ab2b tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-7418b8ea-9763-4e93-920e-9b75066ebb9a req-c559e42b-112e-49be-a8e8-216036f3ab2b tempest-TestInstancesWithCinderVolumes-342809615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-7c8c2983-b356-453f-9cb3-c21199bc0b42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '378e0f7b-1ecb-4ee2-8419-6c5433e23e4a', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:41:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-7418b8ea-9763-4e93-920e-9b75066ebb9a req-c559e42b-112e-49be-a8e8-216036f3ab2b tempest-TestInstancesWithCinderVolumes-342809615 None] attachment_update completed successfully. Nov 06 19:41:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-edd35fae-ab15-45a2-ad07-57de816f74db req-9db79f0f-2cc2-418c-91c5-456e767354b2 tempest-TestInstancesWithCinderVolumes-342809615 None] Terminate volume connection completed successfully. Nov 06 19:41:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-edd35fae-ab15-45a2-ad07-57de816f74db req-9db79f0f-2cc2-418c-91c5-456e767354b2 tempest-TestInstancesWithCinderVolumes-342809615 None] Deleting attachment 73fa7e96-65f5-4f82-a73e-4e96160b5347. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "cinder-11a0dc48-5ece-431c-8545-16f13f9db3c9-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-11a0dc48-5ece-431c-8545-16f13f9db3c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "cinder-quobyte-11a0dc48-5ece-431c-8545-16f13f9db3c9" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-quobyte-11a0dc48-5ece-431c-8545-16f13f9db3c9" acquired by "delete_volume" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d0f62e-41bb-4a68-9a06-62a6040882ff]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:44 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 Nov 06 19:41:44 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-693ceb60-f239-4264-8097-4cb87c14833e tempest-VolumesActionsTest-69529423 None] Acquiring lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d" by "attach_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-693ceb60-f239-4264-8097-4cb87c14833e tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d" acquired by "attach_volume" :: waited 0.074s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-693ceb60-f239-4264-8097-4cb87c14833e tempest-VolumesActionsTest-69529423 None] Attaching volume ff158cd6-827a-49c7-8783-90d765d8c90d to instance aa77a3d9-ea98-4257-ae07-71872f35df31 at mountpoint /dev/vdb on host None. Nov 06 19:41:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-693ceb60-f239-4264-8097-4cb87c14833e tempest-VolumesActionsTest-69529423 None] Attach volume completed successfully. Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-693ceb60-f239-4264-8097-4cb87c14833e tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d" released by "attach_volume" :: held 0.199s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:45 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9" returned: 0 in 0.861s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:45 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9 Nov 06 19:41:45 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7679f7c2-83e4-44c7-8a86-c54c9a443108 tempest-VolumesActionsTest-69529423 None] Acquiring lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-detach_volume" by "detach_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7679f7c2-83e4-44c7-8a86-c54c9a443108 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7679f7c2-83e4-44c7-8a86-c54c9a443108 tempest-VolumesActionsTest-69529423 None] Detaching volume ff158cd6-827a-49c7-8783-90d765d8c90d from instance aa77a3d9-ea98-4257-ae07-71872f35df31. Nov 06 19:41:45 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-11a0dc48-5ece-431c-8545-16f13f9db3c9" returned: 0 in 0.399s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-quobyte-11a0dc48-5ece-431c-8545-16f13f9db3c9" released by "delete_volume" :: held 1.371s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7679f7c2-83e4-44c7-8a86-c54c9a443108 tempest-VolumesActionsTest-69529423 None] Detach volume completed successfully. Nov 06 19:41:45 devstack cinder-volume[86928]: WARNING cinder.quota [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1814022953-1316241092 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1814022953-1316241092, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:41:45 devstack cinder-volume[86928]: WARNING cinder.quota [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1814022953-1316241092 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1814022953-1316241092, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7679f7c2-83e4-44c7-8a86-c54c9a443108 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Created reservations ['3fec68fd-0513-489c-8882-75883c379d85', 'a79c0a25-6dd1-4f57-9417-8c9bc353141d', 'c9365cfd-31d9-4b52-86be-8632245ead1b', 'cb5a4a0a-e468-4415-b389-04694fdd135c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:46 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:41:46 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:46 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.431s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:46 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:41:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Deleted volume successfully. Nov 06 19:41:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-22d771e7-96a8-4bf3-abe0-8cdc2eef298c tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-11a0dc48-5ece-431c-8545-16f13f9db3c9-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:47 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:41:47 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:47 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:41:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:41:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-03365198-39d3-43a2-afd4-ca302a41c29d req-729ad62c-ed0d-464a-ab24-c3e7ad79f311 tempest-TestInstancesWithCinderVolumes-342809615 None] Terminate volume connection completed successfully. Nov 06 19:41:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03365198-39d3-43a2-afd4-ca302a41c29d req-729ad62c-ed0d-464a-ab24-c3e7ad79f311 tempest-TestInstancesWithCinderVolumes-342809615 None] Deleting attachment 378e0f7b-1ecb-4ee2-8419-6c5433e23e4a. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:41:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "cinder-7c8c2983-b356-453f-9cb3-c21199bc0b42-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-7c8c2983-b356-453f-9cb3-c21199bc0b42-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "cinder-quobyte-7c8c2983-b356-453f-9cb3-c21199bc0b42" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-quobyte-7c8c2983-b356-453f-9cb3-c21199bc0b42" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:50 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d506ffd5-3605-4c0d-b8a2-0e870d9a2f31]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:50 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 Nov 06 19:41:50 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:51 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42" returned: 0 in 0.475s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:51 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42 Nov 06 19:41:51 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:51 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c8c2983-b356-453f-9cb3-c21199bc0b42" returned: 0 in 0.306s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-quobyte-7c8c2983-b356-453f-9cb3-c21199bc0b42" released by "delete_volume" :: held 0.844s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:51 devstack cinder-volume[86928]: WARNING cinder.quota [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490714932-702544206 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490714932-702544206, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:41:51 devstack cinder-volume[86928]: WARNING cinder.quota [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490714932-702544206 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490714932-702544206, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Created reservations ['8aad2955-94a4-4e37-8241-a75db92b3e12', '49116e73-f7cb-4258-9a3f-c39c889313d2', 'ee9d6d07-9500-4814-aa8b-d7613785dbe9', 'ba939ea4-4a67-486a-b8cf-2205549f12b2'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:51 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:41:51 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:52 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.380s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:52 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:41:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Deleted volume successfully. Nov 06 19:41:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-534e98b1-739a-4b3c-aa15-559d93f930e1 tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-7c8c2983-b356-453f-9cb3-c21199bc0b42-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:41:52 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:41:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Flow 'volume_create_manager' (47f9d31c-00f5-496b-9eea-8621121730c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c4ca8f-e1cc-475e-800b-0abd13483aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c4ca8f-e1cc-475e-800b-0abd13483aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1757443526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7844330f7bf466480caaac1b1d86c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:53Z,use_quota=True,user_id='9750a471c235405b83e1629dbdc28e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897b1424-2cd3-4659-900c-8688e5608fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897b1424-2cd3-4659-900c-8688e5608fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d155f4-7845-422a-8d80-85ab1c1e493f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d155f4-7845-422a-8d80-85ab1c1e493f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17', 'volume_name': 'volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b0f202-5642-4cc2-a4f9-4d493e83445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b0f202-5642-4cc2-a4f9-4d493e83445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec021a4a-daf6-43fa-b432-535a64396197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Volume 4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17', 'volume_size': 1} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1757443526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7844330f7bf466480caaac1b1d86c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:41:53Z,use_quota=True,user_id='9750a471c235405b83e1629dbdc28e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Creating volume 4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:41:53 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:53 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 1073741824 Nov 06 19:41:53 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:53 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 1073741824" returned: 0 in 0.530s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:53 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 Nov 06 19:41:53 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:53 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17" returned: 0 in 0.272s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec021a4a-daf6-43fa-b432-535a64396197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad14909-33f5-4ad6-a3cb-034296e68b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:41:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Volume volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 (4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17): created successfully Nov 06 19:41:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad14909-33f5-4ad6-a3cb-034296e68b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:41:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Flow 'volume_create_manager' (47f9d31c-00f5-496b-9eea-8621121730c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:41:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9206311f-c246-4859-8ebb-1763b72e9943 tempest-AttachVolumeNegativeTest-2114870787 None] Created volume successfully. Nov 06 19:41:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-d43e9bc1-9b0d-4ccb-a731-71b92aeaf8ec req-3caed32e-7785-4249-a6b0-d7a030408906 tempest-TestInstancesWithCinderVolumes-342809615 None] Terminate volume connection completed successfully. Nov 06 19:41:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-d43e9bc1-9b0d-4ccb-a731-71b92aeaf8ec req-3caed32e-7785-4249-a6b0-d7a030408906 tempest-TestInstancesWithCinderVolumes-342809615 None] Deleting attachment 35a617a2-c952-461a-997e-2f47c76d5c3f. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:41:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-0830e6c8-4b83-49ef-8895-321de671f13f req-65514a5e-2ee0-4541-a25f-88bcfc91cfa2 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:41:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-0830e6c8-4b83-49ef-8895-321de671f13f req-65514a5e-2ee0-4541-a25f-88bcfc91cfa2 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:41:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-0830e6c8-4b83-49ef-8895-321de671f13f req-65514a5e-2ee0-4541-a25f-88bcfc91cfa2 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:41:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-0830e6c8-4b83-49ef-8895-321de671f13f req-65514a5e-2ee0-4541-a25f-88bcfc91cfa2 tempest-AttachVolumeNegativeTest-2114870787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bb2ff8b-0988-4f25-bba0-5b439d374b1a', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:41:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-0830e6c8-4b83-49ef-8895-321de671f13f req-65514a5e-2ee0-4541-a25f-88bcfc91cfa2 tempest-AttachVolumeNegativeTest-2114870787 None] attachment_update completed successfully. Nov 06 19:41:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "cinder-2b4971d3-48d3-4cc5-89a4-ba1066c7c991-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-2b4971d3-48d3-4cc5-89a4-ba1066c7c991-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "cinder-quobyte-2b4971d3-48d3-4cc5-89a4-ba1066c7c991" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:41:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-quobyte-2b4971d3-48d3-4cc5-89a4-ba1066c7c991" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:41:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa50913-1b4e-40e1-92d8-425f3797624d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:41:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:59 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 Nov 06 19:41:59 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:41:59 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Nov 06 19:41:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991" returned: 0 in 0.777s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:41:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:41:59 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991 Nov 06 19:41:59 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:00 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2b4971d3-48d3-4cc5-89a4-ba1066c7c991" returned: 0 in 0.364s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-quobyte-2b4971d3-48d3-4cc5-89a4-ba1066c7c991" released by "delete_volume" :: held 1.241s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:00 devstack cinder-volume[86928]: WARNING cinder.quota [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130805325-1625893832 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130805325-1625893832, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:42:00 devstack cinder-volume[86928]: WARNING cinder.quota [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130805325-1625893832 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2130805325-1625893832, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Created reservations ['7fe0b4fa-dfd0-48fa-82f1-9f48d15349b9', '55d90b3d-6ac2-4dbc-810b-51545b6160f0', '75fba080-d391-4ff3-8146-36ad47ad0aae', 'bd7fd19b-944e-449e-bfe5-9448bf804635'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:00 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:00 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-55c50dba-94a1-493e-b7a1-98541145187f req-db629112-f91e-49d8-abd2-128473ed2139 tempest-AttachVolumeNegativeTest-2114870787 None] Terminate volume connection completed successfully. Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-55c50dba-94a1-493e-b7a1-98541145187f req-db629112-f91e-49d8-abd2-128473ed2139 tempest-AttachVolumeNegativeTest-2114870787 None] Deleting attachment 2bb2ff8b-0988-4f25-bba0-5b439d374b1a. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:42:00 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.563s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:00 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Deleted volume successfully. Nov 06 19:42:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f4b4e3bc-a273-440f-8ce5-bd21ab01e27e tempest-TestInstancesWithCinderVolumes-342809615 None] Lock "cinder-2b4971d3-48d3-4cc5-89a4-ba1066c7c991-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-207206ea-a3a0-4069-8135-81c766150505 tempest-VolumesActionsTest-69529423 None] Acquiring lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d" by "attach_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-207206ea-a3a0-4069-8135-81c766150505 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d" acquired by "attach_volume" :: waited 0.043s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-207206ea-a3a0-4069-8135-81c766150505 tempest-VolumesActionsTest-69529423 None] Attaching volume ff158cd6-827a-49c7-8783-90d765d8c90d to instance c6b9fbc6-96fe-4c35-bb20-76df6e4a43f8 at mountpoint /dev/vdb on host None. Nov 06 19:42:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-207206ea-a3a0-4069-8135-81c766150505 tempest-VolumesActionsTest-69529423 None] Attach volume completed successfully. Nov 06 19:42:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-207206ea-a3a0-4069-8135-81c766150505 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d" released by "attach_volume" :: held 0.275s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2851e51d-3dea-44dd-960a-92e1c9a954e8 tempest-VolumesActionsTest-69529423 None] Acquiring lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-detach_volume" by "detach_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2851e51d-3dea-44dd-960a-92e1c9a954e8 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2851e51d-3dea-44dd-960a-92e1c9a954e8 tempest-VolumesActionsTest-69529423 None] Detaching volume ff158cd6-827a-49c7-8783-90d765d8c90d from instance c6b9fbc6-96fe-4c35-bb20-76df6e4a43f8. Nov 06 19:42:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2851e51d-3dea-44dd-960a-92e1c9a954e8 tempest-VolumesActionsTest-69529423 None] Detach volume completed successfully. Nov 06 19:42:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2851e51d-3dea-44dd-960a-92e1c9a954e8 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "cinder-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "cinder-quobyte-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-quobyte-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4394c8f5-e6ce-4602-b639-96bdb238f225]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:10 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 Nov 06 19:42:10 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:10 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17" returned: 0 in 0.481s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:10 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17 Nov 06 19:42:10 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:10 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17" returned: 0 in 0.363s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-quobyte-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17" released by "delete_volume" :: held 0.915s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Created reservations ['4dfbcee5-70c9-404b-8844-c56a01adcd36', '34b57599-840b-410c-a563-9648a2fd228b', 'bf73ce62-9e8d-48da-a8c0-f5fefeba576f', '623a1cd0-4700-4c0a-ad7d-c58aff221cbe'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:11 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:11 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:11 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.308s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Deleted volume successfully. Nov 06 19:42:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0679b0f3-10b8-4b07-af3c-7482fe2d2ae7 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-4360dd7b-1cec-4eed-8a9b-0bcb0f0d6b17-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "cinder-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "cinder-quobyte-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-quobyte-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9624fc-c5d8-468c-9f21-a15ccb4f1a7a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:12 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc Nov 06 19:42:12 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[875d9f49-28a8-4e4c-bf87-f9d5c0a873d9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:13 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc" returned: 0 in 0.474s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:13 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:42:13 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:13 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc Nov 06 19:42:13 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:13 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:13 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.486s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-quobyte-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc" released by "delete_volume" :: held 0.859s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1584fc2-2337-4033-9286-7fe9310f70e8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Created reservations ['72651921-5ff3-4286-bb51-fc1a885df6e0', '86274c65-9135-48f6-9fa7-15190be0864c', '796c4d7a-9b64-4f01-9de7-6bbe3ee12560', '26389a66-bab1-4864-a218-e59acdbe02ed'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:13 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:42:13 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:13 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:13 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:13 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.480s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.1156d328-ecb3-4d8e-ad4b-48eeb55308411qesj6z6.img {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "cinder-b3ac3706-a6fe-4929-ae5a-40120f40af42-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:13 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.1156d328-ecb3-4d8e-ad4b-48eeb55308411qesj6z6.img Nov 06 19:42:13 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:14 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.389s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Deleted volume successfully. Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-b3ac3706-a6fe-4929-ae5a-40120f40af42-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f43d4029-d263-4a00-81f6-24eb12eba110 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-798ee85b-7a8b-41f7-bcf1-6a39df1dbfcc-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "cinder-quobyte-b3ac3706-a6fe-4929-ae5a-40120f40af42" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-quobyte-b3ac3706-a6fe-4929-ae5a-40120f40af42" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1700f8-446e-4230-8f59-d267c8f6336a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:14 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 Nov 06 19:42:14 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:14 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42" returned: 0 in 0.846s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:15 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42 Nov 06 19:42:15 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:15 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b3ac3706-a6fe-4929-ae5a-40120f40af42" returned: 0 in 0.687s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-quobyte-b3ac3706-a6fe-4929-ae5a-40120f40af42" released by "delete_volume" :: held 1.599s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:15 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Created reservations ['61f0c67f-c12a-4e44-a870-178428c5898f', '34a5fd67-d3ce-4e1d-9e7f-0771baf360e8', '13483719-2654-4211-9b1a-1d14475b028c', 'ec05352f-bab6-4ae0-bf5d-2e1a616c1004'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:16 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:16 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:16 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.601s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:16 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Deleted volume successfully. Nov 06 19:42:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f9611ae4-9ad3-435a-8c2c-9061b3d14db8 tempest-AttachVolumeNegativeTest-2114870787 None] Lock "cinder-b3ac3706-a6fe-4929-ae5a-40120f40af42-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:22 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.1156d328-ecb3-4d8e-ad4b-48eeb55308411qesj6z6.img" returned: 0 in 8.189s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6610e3-c645-4e96-954c-263279a0e6f6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:22 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:42:22 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:22 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.672s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:22 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.1156d328-ecb3-4d8e-ad4b-48eeb55308411qesj6z6.img {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:42:22 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Converted 1024.00 MB image at 125.02 MB/s Nov 06 19:42:22 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] 1156d328-ecb3-4d8e-ad4b-48eeb5530841 was raw, no need to convert to raw {{(pid=86928) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 19:42:30 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=76,cinder:UPDATE=73,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:42:30 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=82,cinder:UPDATE=78,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:42:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:42:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (ec0cd1ec-4249-4f46-9d2d-7f08aa8ad77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b06dd9-da6e-477e-8f1a-96831e6e5247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b06dd9-da6e-477e-8f1a-96831e6e5247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371633231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d593e9d9-2db6-4f0a-b702-712959287c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:31Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc28d01-bfc4-4e95-9335-ef46e6281ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc28d01-bfc4-4e95-9335-ef46e6281ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444b81d2-e976-41f9-aba7-e7b31435deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444b81d2-e976-41f9-aba7-e7b31435deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd593e9d9-2db6-4f0a-b702-712959287c93', 'volume_name': 'volume-d593e9d9-2db6-4f0a-b702-712959287c93', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b82d534-a42e-4230-9008-462cf647e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b82d534-a42e-4230-9008-462cf647e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc90796-2374-4126-84f6-933463b98230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Volume d593e9d9-2db6-4f0a-b702-712959287c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d593e9d9-2db6-4f0a-b702-712959287c93', 'volume_size': 1} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (971a6be5-ba72-4f0c-b859-23aa0fda10c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f9df6e-68f4-4331-8690-a72e77364840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f9df6e-68f4-4331-8690-a72e77364840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1389269272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab6c5ac-fb41-405a-80fa-605fe47356a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:31Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cf265c-b1ca-4c03-acfc-4bd6e2fb6bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cf265c-b1ca-4c03-acfc-4bd6e2fb6bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9af1433-d0ca-41e0-b67a-467e99751eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9af1433-d0ca-41e0-b67a-467e99751eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab6c5ac-fb41-405a-80fa-605fe47356a2', 'volume_name': 'volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2a6559-209a-44e5-bb85-8432ea7c38c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2a6559-209a-44e5-bb85-8432ea7c38c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d92cc8-02f7-4196-b4cf-ca45d314631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Volume 1ab6c5ac-fb41-405a-80fa-605fe47356a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2', 'volume_size': 1} Nov 06 19:42:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (64165114-9dae-4ac4-b30d-1dab6fadcef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669178cc-e430-487b-b60b-2f77b5ae41fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669178cc-e430-487b-b60b-2f77b5ae41fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1379396184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d45ad21-e0a9-4da2-9d46-f6c37ab880c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:32Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d76f088-d67c-4dd9-8036-8a79b336deaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d76f088-d67c-4dd9-8036-8a79b336deaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab62d9d-d0ab-47a1-947a-3a8f1e793cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab62d9d-d0ab-47a1-947a-3a8f1e793cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d45ad21-e0a9-4da2-9d46-f6c37ab880c7', 'volume_name': 'volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87832fe9-eac3-442b-9a1a-11213b4ef434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87832fe9-eac3-442b-9a1a-11213b4ef434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ab86e2-33c1-41da-8f17-cb0609888074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Volume 4d45ad21-e0a9-4da2-9d46-f6c37ab880c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7', 'volume_size': 1} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (42822617-ddd9-4148-bb64-b894301fe960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31436f65-85b4-4031-ac1f-d2ee5a4ce944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31436f65-85b4-4031-ac1f-d2ee5a4ce944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748407590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911e9ba0-56d5-4379-bfad-84203a16cf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:33Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c6ad72-a38d-499c-b38a-ed06fa0d8ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c6ad72-a38d-499c-b38a-ed06fa0d8ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0254eea4-6ce2-4012-b085-08d8729270d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0254eea4-6ce2-4012-b085-08d8729270d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911e9ba0-56d5-4379-bfad-84203a16cf19', 'volume_name': 'volume-911e9ba0-56d5-4379-bfad-84203a16cf19', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0f44d8-eaf8-4f12-86b2-61fba0d9e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0f44d8-eaf8-4f12-86b2-61fba0d9e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3383970-d96e-4e22-9231-1a431fa79757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Volume 911e9ba0-56d5-4379-bfad-84203a16cf19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911e9ba0-56d5-4379-bfad-84203a16cf19', 'volume_size': 1} Nov 06 19:42:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:33 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:42:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (897a0d53-8eb6-42e0-9ec9-b8a6ad35e630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebd024f-ac23-4738-bf9d-dfe323948bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebd024f-ac23-4738-bf9d-dfe323948bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1156722315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b86c86-7062-4922-8e6f-8e21a814fa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:34Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3a9a19-e390-43fe-bef7-016eabea2304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3a9a19-e390-43fe-bef7-016eabea2304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cab8e6-2e59-4057-9d06-9dc79fa0f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cab8e6-2e59-4057-9d06-9dc79fa0f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b86c86-7062-4922-8e6f-8e21a814fa86', 'volume_name': 'volume-97b86c86-7062-4922-8e6f-8e21a814fa86', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf5b46a-6cc4-419f-8a30-0fa46f3ebc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf5b46a-6cc4-419f-8a30-0fa46f3ebc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0923b0e-c201-457e-8e2a-c982e75b92b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Volume 97b86c86-7062-4922-8e6f-8e21a814fa86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b86c86-7062-4922-8e6f-8e21a814fa86', 'volume_size': 1} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Flow 'volume_create_manager' (94c8df72-ec39-48ac-9c35-9e6bed08d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361dd653-f0fb-47eb-878a-8e2665241060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361dd653-f0fb-47eb-878a-8e2665241060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-97282929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02a2ec579a94bba82f0a1d8fed541be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:34Z,use_quota=True,user_id='241dccaf0ae24bc3a4c00edaa4b14259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded02e3e-10f6-4c2a-9e4f-15da73dae60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded02e3e-10f6-4c2a-9e4f-15da73dae60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a9d3e5-dea4-4409-abd5-f380a20b0d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a9d3e5-dea4-4409-abd5-f380a20b0d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775', 'volume_name': 'volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2f8911-6f91-460d-af34-d743c4017c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2f8911-6f91-460d-af34-d743c4017c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336e7cb0-05c3-4a85-b230-acd062565e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Volume 3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775', 'volume_size': 1} Nov 06 19:42:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (57a69f10-be04-43ba-b79b-23e6ba1b0624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d76725b-eaba-4621-bf5f-ed6e2e6230de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d76725b-eaba-4621-bf5f-ed6e2e6230de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566767431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b9d58c-5718-4637-afde-626213d2e161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:41Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb260590-0f21-4ebf-8578-56486df94c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb260590-0f21-4ebf-8578-56486df94c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe845ef-b18c-4e85-a3d1-effd440e8a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe845ef-b18c-4e85-a3d1-effd440e8a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b9d58c-5718-4637-afde-626213d2e161', 'volume_name': 'volume-d2b9d58c-5718-4637-afde-626213d2e161', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2774c653-b750-460d-8e10-990f754713f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2774c653-b750-460d-8e10-990f754713f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc228a35-3317-47a8-8721-e5272b14afca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:40 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Volume d2b9d58c-5718-4637-afde-626213d2e161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b9d58c-5718-4637-afde-626213d2e161', 'volume_size': 1} Nov 06 19:42:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:47 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:47 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:47 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.353s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:42:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Uploaded volume to glance image-id: 1156d328-ecb3-4d8e-ad4b-48eeb5530841. {{(pid=86928) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.805s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-371633231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d593e9d9-2db6-4f0a-b702-712959287c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:31Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Creating volume d593e9d9-2db6-4f0a-b702-712959287c93 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:42:48 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:42:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:48 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 1073741824 Nov 06 19:42:48 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-98d191b7-8737-46a5-8780-246fc0958d1a tempest-VolumesActionsTest-69529423 None] Copy volume to image completed successfully. Nov 06 19:42:49 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 1073741824" returned: 0 in 0.446s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:49 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 Nov 06 19:42:49 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:49 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93" returned: 0 in 0.299s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.093s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1389269272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab6c5ac-fb41-405a-80fa-605fe47356a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:31Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Creating volume 1ab6c5ac-fb41-405a-80fa-605fe47356a2 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:42:49 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc90796-2374-4126-84f6-933463b98230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d593e9d9-2db6-4f0a-b702-712959287c93', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b492816d-07a5-4482-a36c-42515d5c498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:49 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 1073741824 Nov 06 19:42:49 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:49 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Volume volume-d593e9d9-2db6-4f0a-b702-712959287c93 (d593e9d9-2db6-4f0a-b702-712959287c93): created successfully Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b492816d-07a5-4482-a36c-42515d5c498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (ec0cd1ec-4249-4f46-9d2d-7f08aa8ad77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7b7d41d5-86bd-49c7-8bb0-f8d03b02f794 tempest-CreateVolumesFromImageTest-235216395 None] Created volume successfully. Nov 06 19:42:50 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 1073741824" returned: 0 in 0.574s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:50 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 Nov 06 19:42:50 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:50 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2" returned: 0 in 0.281s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.404s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1379396184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d45ad21-e0a9-4da2-9d46-f6c37ab880c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:32Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Creating volume 4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:42:50 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:50 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 1073741824 Nov 06 19:42:50 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d92cc8-02f7-4196-b4cf-ca45d314631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366c401a-b50e-4f89-b650-5715a8397a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Volume volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 (1ab6c5ac-fb41-405a-80fa-605fe47356a2): created successfully Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366c401a-b50e-4f89-b650-5715a8397a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (971a6be5-ba72-4f0c-b859-23aa0fda10c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c71c8208-1d5e-46e0-9174-b93ae9dce865 tempest-CreateVolumesFromImageTest-235216395 None] Created volume successfully. Nov 06 19:42:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:51 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 1073741824" returned: 0 in 0.452s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:51 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 Nov 06 19:42:51 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:51 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7" returned: 0 in 0.244s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.347s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748407590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911e9ba0-56d5-4379-bfad-84203a16cf19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:33Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Creating volume 911e9ba0-56d5-4379-bfad-84203a16cf19 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:42:51 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ab86e2-33c1-41da-8f17-cb0609888074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:51 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 1073741824 Nov 06 19:42:51 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b6fc56-c60c-432c-ad6a-9c1023f44701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Volume volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 (4d45ad21-e0a9-4da2-9d46-f6c37ab880c7): created successfully Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b6fc56-c60c-432c-ad6a-9c1023f44701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (64165114-9dae-4ac4-b30d-1dab6fadcef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9fb4f7e7-32c1-4dce-9c66-e532c6c747d4 tempest-CreateVolumesFromImageTest-235216395 None] Created volume successfully. Nov 06 19:42:51 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 1073741824" returned: 0 in 0.426s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:51 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 Nov 06 19:42:51 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:52 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19" returned: 0 in 0.251s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.970s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1156722315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b86c86-7062-4922-8e6f-8e21a814fa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cf931a418f4df98d1443327649d374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:34Z,use_quota=True,user_id='485232c4b1eb48ff8210202b868b15dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Creating volume 97b86c86-7062-4922-8e6f-8e21a814fa86 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:42:52 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3383970-d96e-4e22-9231-1a431fa79757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911e9ba0-56d5-4379-bfad-84203a16cf19', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1c47b5-8eb6-4adb-8ea3-94683c95f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:52 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 1073741824 Nov 06 19:42:52 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Volume volume-911e9ba0-56d5-4379-bfad-84203a16cf19 (911e9ba0-56d5-4379-bfad-84203a16cf19): created successfully Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1c47b5-8eb6-4adb-8ea3-94683c95f802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (42822617-ddd9-4148-bb64-b894301fe960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e1e3ae72-0ea5-4e52-bfe3-a0b6d54f4934 tempest-CreateVolumesFromImageTest-235216395 None] Created volume successfully. Nov 06 19:42:52 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 1073741824" returned: 0 in 0.409s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:52 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 Nov 06 19:42:52 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:52 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86" returned: 0 in 0.249s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.525s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-97282929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c02a2ec579a94bba82f0a1d8fed541be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:34Z,use_quota=True,user_id='241dccaf0ae24bc3a4c00edaa4b14259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Creating volume 3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:42:52 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0923b0e-c201-457e-8e2a-c982e75b92b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b86c86-7062-4922-8e6f-8e21a814fa86', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:52 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 1073741824 Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24476f7d-97d9-414a-b48c-c89ad2fe1744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:52 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Volume volume-97b86c86-7062-4922-8e6f-8e21a814fa86 (97b86c86-7062-4922-8e6f-8e21a814fa86): created successfully Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24476f7d-97d9-414a-b48c-c89ad2fe1744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Flow 'volume_create_manager' (897a0d53-8eb6-42e0-9ec9-b8a6ad35e630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2f7500cf-2bc4-491e-87e2-53522c41c634 tempest-CreateVolumesFromImageTest-235216395 None] Created volume successfully. Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-97b86c86-7062-4922-8e6f-8e21a814fa86-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-97b86c86-7062-4922-8e6f-8e21a814fa86-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-quobyte-97b86c86-7062-4922-8e6f-8e21a814fa86" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:53 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-97b86c86-7062-4922-8e6f-8e21a814fa86" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 1073741824" returned: 0 in 0.495s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[948a0e66-9969-4af0-8f39-d0faff7e6767]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:53 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 Nov 06 19:42:53 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:53 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 Nov 06 19:42:53 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:53 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.671s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566767431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b9d58c-5718-4637-afde-626213d2e161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:42:41Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Creating volume d2b9d58c-5718-4637-afde-626213d2e161 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:42:53 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:53 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 1073741824 Nov 06 19:42:53 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:53 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86" returned: 0 in 0.452s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:53 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86 Nov 06 19:42:53 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:54 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-97b86c86-7062-4922-8e6f-8e21a814fa86" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-97b86c86-7062-4922-8e6f-8e21a814fa86" released by "delete_volume" :: held 0.793s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:54 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 1073741824" returned: 0 in 0.473s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Created reservations ['5b198f78-16bd-44fa-aa65-f1bffbffeb46', 'ca7b4780-3b73-4dd0-b4e9-9cf1c6e39e49', '5faec10c-9409-4945-9431-0df448aa91b5', '3584af63-26e0-4303-b4a3-9ff0ff70583b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336e7cb0-05c3-4a85-b230-acd062565e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832ca5bc-5ae7-43c7-9b3e-0d86dc70a23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:54 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Volume volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 (3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775): created successfully Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832ca5bc-5ae7-43c7-9b3e-0d86dc70a23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Flow 'volume_create_manager' (94c8df72-ec39-48ac-9c35-9e6bed08d84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-03519fe8-9af0-4842-baa6-e8642f84b466 req-5fe4bfa6-8b30-47f0-b2b1-8db01717a252 tempest-VolumesGetTestJSON-1245902795 None] Created volume successfully. Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:54 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 Nov 06 19:42:54 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:54 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:54 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-911e9ba0-56d5-4379-bfad-84203a16cf19-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-911e9ba0-56d5-4379-bfad-84203a16cf19-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-quobyte-911e9ba0-56d5-4379-bfad-84203a16cf19" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-911e9ba0-56d5-4379-bfad-84203a16cf19" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37563ee-381a-4d74-b28a-0297559eba1e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:54 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.781s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc228a35-3317-47a8-8721-e5272b14afca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b9d58c-5718-4637-afde-626213d2e161', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7c1ac3-dcc3-41b6-b6e3-0d68df0227e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1910ecc-18a2-4d4e-9ebe-49902aedef64]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:54 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Volume volume-d2b9d58c-5718-4637-afde-626213d2e161 (d2b9d58c-5718-4637-afde-626213d2e161): created successfully Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7c1ac3-dcc3-41b6-b6e3-0d68df0227e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:42:54 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (57a69f10-be04-43ba-b79b-23e6ba1b0624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.332s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Deleted volume successfully. Nov 06 19:42:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0c9db4ff-ab67-4a6a-9ba1-5e2e00b05a9e tempest-VolumesActionsTest-1893032717 None] Created volume successfully. Nov 06 19:42:54 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 Nov 06 19:42:54 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a2e9bf4b-f27c-42b0-839c-3935691f59fc tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-97b86c86-7062-4922-8e6f-8e21a814fa86-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:54 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:42:54 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:54 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19" returned: 0 in 0.447s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:54 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19 Nov 06 19:42:54 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:55 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.433s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd2ef60-b215-4814-9db2-623a8109f031]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:55 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:42:55 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:55 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Acquiring lock "cinder-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-911e9ba0-56d5-4379-bfad-84203a16cf19" returned: 0 in 0.295s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-911e9ba0-56d5-4379-bfad-84203a16cf19" released by "delete_volume" :: held 0.808s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Lock "cinder-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Acquiring lock "cinder-quobyte-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Lock "cinder-quobyte-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Created reservations ['6b41b85f-0e04-4642-92f3-372efac3536e', 'f9f455f3-5585-48bc-bc2e-2735c160ea32', '315edf7f-1027-49d0-a87a-09ac530259ec', '2a3041eb-664e-4f3e-bd43-4b1503aaa49b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439f456-4191-4450-bc2f-fb09b3eb442a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:55 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 Nov 06 19:42:55 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:55 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.542s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:55 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:55 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:55 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img Nov 06 19:42:55 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-quobyte-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7" acquired by "delete_volume" :: waited 0.049s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:55 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.379s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85967e39-ac56-4b9d-b2c6-b2b69f960ad0 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161" by "attach_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb699c6-4015-4f4b-8a3e-407bebc8de48]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:55 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Deleted volume successfully. Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775" returned: 0 in 0.567s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85967e39-ac56-4b9d-b2c6-b2b69f960ad0 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161" acquired by "attach_volume" :: waited 0.118s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:56 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775 Nov 06 19:42:56 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f0633892-a4ce-4a36-9f4a-9749f061f4ec tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-911e9ba0-56d5-4379-bfad-84203a16cf19-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:56 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 Nov 06 19:42:56 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-85967e39-ac56-4b9d-b2c6-b2b69f960ad0 tempest-VolumesActionsTest-1893032717 None] Attaching volume d2b9d58c-5718-4637-afde-626213d2e161 to instance 1b6f15f7-a65c-4cc9-84a4-4cb2f6ba4180 at mountpoint /dev/vdb on host None. Nov 06 19:42:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-85967e39-ac56-4b9d-b2c6-b2b69f960ad0 tempest-VolumesActionsTest-1893032717 None] Attach volume completed successfully. Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85967e39-ac56-4b9d-b2c6-b2b69f960ad0 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161" released by "attach_volume" :: held 0.304s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:56 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775" returned: 0 in 0.749s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Lock "cinder-quobyte-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775" released by "delete_volume" :: held 1.404s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG cinder.quota [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Created reservations ['055f1042-e67d-4247-840f-6a2462ee6784', '5142cecb-01a1-48ef-8d1f-40595812d3b1', 'e8d9f2cf-111c-4c3c-b3ca-34cf0dc689db', '32307e26-8f31-4de5-be53-ac02c5de8d81'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:56 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7" returned: 0 in 1.013s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:57 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7 Nov 06 19:42:57 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:57 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:57 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:57 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7" returned: 0 in 0.574s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7" released by "delete_volume" :: held 1.674s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Created reservations ['868fb610-db9c-4f06-85fd-5a36afcdd126', 'dc0103d2-eae6-423a-b297-8a03c943be8f', '74d1f155-faf1-462b-82c1-58f9b981d22c', '12cda09b-8701-441e-bd50-d85f00c81bab'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:42:57 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.659s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG cinder.manager [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:57 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Deleted volume successfully. Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:42:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:58 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-bb3609af-811f-4a46-8030-974b05f3a14f req-e2f5abe6-40d1-49cf-9e9e-655164d327eb tempest-VolumesGetTestJSON-1245902795 None] Lock "cinder-3dcaba31-f6f6-4d69-83cd-ca8f3b3e3775-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:58 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d3827fc3-82e8-4829-a62e-ec12c37dd8e1 tempest-VolumesActionsTest-1474028955 None] Terminate volume connection completed successfully. Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-1ab6c5ac-fb41-405a-80fa-605fe47356a2-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d3827fc3-82e8-4829-a62e-ec12c37dd8e1 tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-detach_volume" by "detach_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-1ab6c5ac-fb41-405a-80fa-605fe47356a2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d3827fc3-82e8-4829-a62e-ec12c37dd8e1 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d3827fc3-82e8-4829-a62e-ec12c37dd8e1 tempest-VolumesActionsTest-1474028955 None] Detaching volume d2b9d58c-5718-4637-afde-626213d2e161 from instance 1b6f15f7-a65c-4cc9-84a4-4cb2f6ba4180. Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-quobyte-1ab6c5ac-fb41-405a-80fa-605fe47356a2" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-1ab6c5ac-fb41-405a-80fa-605fe47356a2" acquired by "delete_volume" :: waited 0.065s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d3827fc3-82e8-4829-a62e-ec12c37dd8e1 tempest-VolumesActionsTest-1474028955 None] Detach volume completed successfully. Nov 06 19:42:58 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d3827fc3-82e8-4829-a62e-ec12c37dd8e1 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-detach_volume" released by "detach_volume" :: held 0.246s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[836fe9a2-e4fc-4d31-afbe-cd9c03ac1dc6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.695s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:42:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Deleted volume successfully. Nov 06 19:42:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaf78dfa-cec9-4255-9537-faf2ebc99b0a tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-4d45ad21-e0a9-4da2-9d46-f6c37ab880c7-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:58 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 Nov 06 19:42:58 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-13152278-46a0-430c-8a95-68ef1685ce4c tempest-VolumesActionsTest-1893032717 None] Acquiring lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-detach_volume" by "detach_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-13152278-46a0-430c-8a95-68ef1685ce4c tempest-VolumesActionsTest-1893032717 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-13152278-46a0-430c-8a95-68ef1685ce4c tempest-VolumesActionsTest-1893032717 None] Volume detach called, but volume not attached. Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-13152278-46a0-430c-8a95-68ef1685ce4c tempest-VolumesActionsTest-1893032717 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:42:59 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2" returned: 0 in 0.960s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:42:59 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2 Nov 06 19:42:59 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "cinder-quobyte-d2b9d58c-5718-4637-afde-626213d2e161" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-quobyte-d2b9d58c-5718-4637-afde-626213d2e161" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9622c576-6560-424f-b0c5-f172beb78051]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:42:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:00 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1ab6c5ac-fb41-405a-80fa-605fe47356a2" returned: 0 in 0.545s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:00 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 Nov 06 19:43:00 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-1ab6c5ac-fb41-405a-80fa-605fe47356a2" released by "delete_volume" :: held 1.604s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Created reservations ['561f648a-067e-4aa1-8b6f-a372017a874b', '9d98394e-b057-4ac1-b1b4-557ecb99f4e7', '9bd08504-a820-4ca5-8f03-456c2b89fcaa', 'bf87e51e-7f6e-489c-9e4b-42c8a5caad7c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:00 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:00 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:00 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161" returned: 0 in 0.668s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:00 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161 Nov 06 19:43:00 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-d593e9d9-2db6-4f0a-b702-712959287c93-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-d593e9d9-2db6-4f0a-b702-712959287c93-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "cinder-quobyte-d593e9d9-2db6-4f0a-b702-712959287c93" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-d593e9d9-2db6-4f0a-b702-712959287c93" acquired by "delete_volume" :: waited 0.036s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee74fab-dc2d-4eb6-8ef4-25d33da48b6d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:01 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.735s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Deleted volume successfully. Nov 06 19:43:01 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa85dd2d-ef41-4c9a-ba02-f68cda309d24 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-1ab6c5ac-fb41-405a-80fa-605fe47356a2-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d2b9d58c-5718-4637-afde-626213d2e161" returned: 0 in 0.686s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-quobyte-d2b9d58c-5718-4637-afde-626213d2e161" released by "delete_volume" :: held 1.468s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:01 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 Nov 06 19:43:01 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Created reservations ['d55c37e3-e1ea-40e8-97d2-a85cabd1bf28', 'be105ed6-7a3f-4421-992f-bd26e410f936', '10bdda9d-6399-4d59-a9e6-f0d02abf06ad', 'ba3a71c3-d22b-44ad-8361-6078360e52d5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:01 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:01 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:01 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93" returned: 0 in 0.863s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:02 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93 Nov 06 19:43:02 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:02 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.479s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Deleted volume successfully. Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-67335109-cec9-4c4d-af90-1c521cf509d4 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-d2b9d58c-5718-4637-afde-626213d2e161-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:02 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d593e9d9-2db6-4f0a-b702-712959287c93" returned: 0 in 0.657s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-quobyte-d593e9d9-2db6-4f0a-b702-712959287c93" released by "delete_volume" :: held 1.662s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Created reservations ['c3707e0d-bfb0-4052-b4ea-39907ae29f15', '71a38f1b-db50-45f9-8bdd-5342aa0cf650', '09c5eac8-a3bd-4b92-bbc9-e7a453641293', '760ffe59-c4af-4b44-ba49-fdcdacc3fb2f'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:03 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:03 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:03 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.915s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:03 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Deleted volume successfully. Nov 06 19:43:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5f53b8e-a4ec-43f6-bf4d-9563b1cc37c0 tempest-CreateVolumesFromImageTest-235216395 None] Lock "cinder-d593e9d9-2db6-4f0a-b702-712959287c93-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:06 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img" returned: 0 in 10.651s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c369a4-66dd-4800-b30e-16ef545e9f21]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:06 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:43:06 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:06 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.684s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d, size 1024.00 MB, duration 10.65 sec, destination /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:43:06 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Converted 1024.00 MB image at 96.13 MB/s Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Flow 'volume_create_manager' (c3f1244a-7e7c-45b7-8b5c-da1d0b0d593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d0c2ee-9202-4f75-b603-cef805ccbe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d0c2ee-9202-4f75-b603-cef805ccbe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-559103897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed100915-4a68-4c4f-b6d0-39d86b885241,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83cc87ab06b142318bb532a5cbb13b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:07Z,use_quota=True,user_id='4f1196ad55a24253a999a8b36c2d4fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73e76a3-7b68-46dd-b0cc-c6081bc6d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73e76a3-7b68-46dd-b0cc-c6081bc6d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eb1fad-0dbb-4769-864a-85bd8bac573b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eb1fad-0dbb-4769-864a-85bd8bac573b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed100915-4a68-4c4f-b6d0-39d86b885241', 'volume_name': 'volume-ed100915-4a68-4c4f-b6d0-39d86b885241', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155f22a4-d6e3-4fe0-ba05-20c818dfbbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155f22a4-d6e3-4fe0-ba05-20c818dfbbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5972721d-e12f-4acf-b5b3-45783ad07832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Volume ed100915-4a68-4c4f-b6d0-39d86b885241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed100915-4a68-4c4f-b6d0-39d86b885241', 'volume_size': 1} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] 5a6c179b-ec7d-4279-8821-ddcacf790a49 was raw, converting to qcow2 {{(pid=86928) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b401799-0215-4007-9599-356f3bf3a3cf]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:07 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img Nov 06 19:43:07 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (9f7f7551-491a-4f9c-8029-22cfa3093c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ee1498-5834-437e-8839-0673efa8587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ee1498-5834-437e-8839-0673efa8587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-886114244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ce9791-c45b-4905-8643-496d5d2f5abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:07Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a867e29b-de95-4a00-85b2-db7cd82943cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a867e29b-de95-4a00-85b2-db7cd82943cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bcdcc0-22f4-44f5-937c-16dee3e00770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bcdcc0-22f4-44f5-937c-16dee3e00770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ce9791-c45b-4905-8643-496d5d2f5abd', 'volume_name': 'volume-89ce9791-c45b-4905-8643-496d5d2f5abd', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:07 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51709b26-c0e0-48ff-bcf7-c3f98e166a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51709b26-c0e0-48ff-bcf7-c3f98e166a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ebfbe6-00d2-4032-86e2-7728e9d3df4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:07 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Volume 89ce9791-c45b-4905-8643-496d5d2f5abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ce9791-c45b-4905-8643-496d5d2f5abd', 'volume_size': 1} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img" returned: 0 in 0.376s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:07 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img Nov 06 19:43:07 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:07 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img" returned: 1 in 0.338s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:43:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img /opt/stack/data/cinder/conversion/vol_upload_vy_h3bu2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:07 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img /opt/stack/data/cinder/conversion/vol_upload_vy_h3bu2 Nov 06 19:43:07 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:08 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img /opt/stack/data/cinder/conversion/vol_upload_vy_h3bu2" returned: 0 in 0.257s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Image conversion details: src /opt/stack/data/cinder/conversion/ff158cd6-827a-49c7-8783-90d765d8c90d.temp_image.5a6c179b-ec7d-4279-8821-ddcacf790a49o1lu8t6_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vy_h3bu2 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:43:08 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3be6ec-2cf0-4e82-b8ea-7998cdaa1d0f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy_h3bu2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:08 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy_h3bu2 Nov 06 19:43:08 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:08 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy_h3bu2" returned: 0 in 0.341s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Flow 'volume_create_manager' (257778cd-a5ca-4769-aea1-169ebc37d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4694b896-d47f-4460-a161-298b3726c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4694b896-d47f-4460-a161-298b3726c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1952211597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4399b10f-f95e-4fab-8b05-326ff9adea5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f9176890174e77a71f215361542aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:08Z,use_quota=True,user_id='d18752e5b4e44416bdb026b5112910ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9926987a-2b3b-42d0-bcc7-1371a7831290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9926987a-2b3b-42d0-bcc7-1371a7831290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1477e73f-e738-48c5-972e-dcecd3bd9b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1477e73f-e738-48c5-972e-dcecd3bd9b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4399b10f-f95e-4fab-8b05-326ff9adea5b', 'volume_name': 'volume-4399b10f-f95e-4fab-8b05-326ff9adea5b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8efcd18-8825-41e8-a558-4bf972a8d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8efcd18-8825-41e8-a558-4bf972a8d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23868007-7637-4b60-8bbb-8f8bed8a8721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:08 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Volume 4399b10f-f95e-4fab-8b05-326ff9adea5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4399b10f-f95e-4fab-8b05-326ff9adea5b', 'volume_size': 1} Nov 06 19:43:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.093s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Uploaded volume to glance image-id: 5a6c179b-ec7d-4279-8821-ddcacf790a49. {{(pid=86928) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-559103897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed100915-4a68-4c4f-b6d0-39d86b885241,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83cc87ab06b142318bb532a5cbb13b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:07Z,use_quota=True,user_id='4f1196ad55a24253a999a8b36c2d4fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Creating volume ed100915-4a68-4c4f-b6d0-39d86b885241 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:09 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:09 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 1073741824 Nov 06 19:43:09 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:09 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-da43e3a3-8a2e-4078-b098-a76c890f891f tempest-VolumesActionsTest-69529423 None] Copy volume to image completed successfully. Nov 06 19:43:10 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 1073741824" returned: 0 in 0.447s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:10 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 Nov 06 19:43:10 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:10 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241" returned: 0 in 0.242s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.959s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-886114244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ce9791-c45b-4905-8643-496d5d2f5abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:07Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Creating volume 89ce9791-c45b-4905-8643-496d5d2f5abd {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:10 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Acquiring lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:10 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd 1073741824 Nov 06 19:43:10 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5972721d-e12f-4acf-b5b3-45783ad07832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed100915-4a68-4c4f-b6d0-39d86b885241', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b55672-77b8-4ed3-aaa8-6482a9e85805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:10 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Volume volume-ed100915-4a68-4c4f-b6d0-39d86b885241 (ed100915-4a68-4c4f-b6d0-39d86b885241): created successfully Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b55672-77b8-4ed3-aaa8-6482a9e85805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Flow 'volume_create_manager' (c3f1244a-7e7c-45b7-8b5c-da1d0b0d593b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-508dbc7d-354c-433c-8462-ed8740a7f310 tempest-VolumesTestJSON-2079620788 None] Created volume successfully. Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Acquiring lock "cinder-quobyte-ff158cd6-827a-49c7-8783-90d765d8c90d" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Lock "cinder-quobyte-ff158cd6-827a-49c7-8783-90d765d8c90d" acquired by "delete_volume" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb1328a-6c55-4ee7-a37f-8e3e03414018]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:10 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:43:10 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:10 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd 1073741824" returned: 0 in 0.469s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:10 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd Nov 06 19:43:10 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:10 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.385s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:10 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d Nov 06 19:43:10 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:11 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd" returned: 0 in 0.265s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.595s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1952211597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4399b10f-f95e-4fab-8b05-326ff9adea5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f9176890174e77a71f215361542aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:08Z,use_quota=True,user_id='d18752e5b4e44416bdb026b5112910ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Creating volume 4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:11 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ebfbe6-00d2-4032-86e2-7728e9d3df4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ce9791-c45b-4905-8643-496d5d2f5abd', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:11 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b 1073741824 Nov 06 19:43:11 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec32c38-5d21-43eb-aebd-0be249d926dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Volume volume-89ce9791-c45b-4905-8643-496d5d2f5abd (89ce9791-c45b-4905-8643-496d5d2f5abd): created successfully Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec32c38-5d21-43eb-aebd-0be249d926dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:11 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (9f7f7551-491a-4f9c-8029-22cfa3093c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ff158cd6-827a-49c7-8783-90d765d8c90d" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Lock "cinder-quobyte-ff158cd6-827a-49c7-8783-90d765d8c90d" released by "delete_volume" :: held 0.731s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d1c4b85f-8cd5-4a29-b8f0-70a8d5f7513b tempest-VolumesActionsTest-1893032717 None] Created volume successfully. Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Created reservations ['dd47eba3-f563-47e9-9c6d-85b2cf7522b1', '26d3555f-564c-4644-8b1e-9c89056844bf', '81a98e30-0533-4034-a86d-1866132fc6c7', 'da4c188e-6445-4947-9da0-39aee02c6db4'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:11 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:11 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:11 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Deleted volume successfully. Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f087f732-b48c-4397-b8be-1b2bb1372bd0 tempest-VolumesActionsTest-69529423 None] Lock "cinder-ff158cd6-827a-49c7-8783-90d765d8c90d-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:11 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b 1073741824" returned: 0 in 0.707s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-89ce9791-c45b-4905-8643-496d5d2f5abd-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Lock "cinder-89ce9791-c45b-4905-8643-496d5d2f5abd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:12 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b Nov 06 19:43:12 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-quobyte-89ce9791-c45b-4905-8643-496d5d2f5abd" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-89ce9791-c45b-4905-8643-496d5d2f5abd" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Flow 'volume_create_manager' (ed25448b-92d0-4c2f-b8e3-11ace1590244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6633f525-1388-43ed-9e0b-5f4e74b71704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[148825f7-b77c-4c09-b78a-1d1091677182]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6633f525-1388-43ed-9e0b-5f4e74b71704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-974398178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d63c6f-3793-4568-b9ca-efa3a21079f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83cc87ab06b142318bb532a5cbb13b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:12Z,use_quota=True,user_id='4f1196ad55a24253a999a8b36c2d4fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe0d6fc-dd80-43de-8e34-39fae2c5de2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe0d6fc-dd80-43de-8e34-39fae2c5de2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac37d2a-873b-4b9d-83da-dca4079d4d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac37d2a-873b-4b9d-83da-dca4079d4d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d63c6f-3793-4568-b9ca-efa3a21079f4', 'volume_name': 'volume-25d63c6f-3793-4568-b9ca-efa3a21079f4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbad579a-3181-4be5-b2ae-e08fa4097d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbad579a-3181-4be5-b2ae-e08fa4097d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baa897d-4679-45ab-9d29-b7868a6744cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:12 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Volume 25d63c6f-3793-4568-b9ca-efa3a21079f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d63c6f-3793-4568-b9ca-efa3a21079f4', 'volume_size': 1} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:12 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd Nov 06 19:43:12 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:12 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b" returned: 0 in 0.318s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-974398178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d63c6f-3793-4568-b9ca-efa3a21079f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83cc87ab06b142318bb532a5cbb13b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:12Z,use_quota=True,user_id='4f1196ad55a24253a999a8b36c2d4fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Creating volume 25d63c6f-3793-4568-b9ca-efa3a21079f4 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:12 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23868007-7637-4b60-8bbb-8f8bed8a8721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4399b10f-f95e-4fab-8b05-326ff9adea5b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:12 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 1073741824 Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b325e6bf-bd43-4f67-b051-4aef73a3ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:12 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:12 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Volume volume-4399b10f-f95e-4fab-8b05-326ff9adea5b (4399b10f-f95e-4fab-8b05-326ff9adea5b): created successfully Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b325e6bf-bd43-4f67-b051-4aef73a3ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Flow 'volume_create_manager' (257778cd-a5ca-4769-aea1-169ebc37d806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:12 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8b6b1bdd-76fd-4b5b-a4c2-f166898d9752 tempest-VolumeDependencyTests-1613485969 None] Created volume successfully. Nov 06 19:43:12 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd" returned: 0 in 0.451s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:12 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd Nov 06 19:43:12 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:12 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 1073741824" returned: 0 in 0.511s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:12 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-89ce9791-c45b-4905-8643-496d5d2f5abd" returned: 0 in 0.283s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:12 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 Nov 06 19:43:12 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-89ce9791-c45b-4905-8643-496d5d2f5abd" released by "delete_volume" :: held 0.834s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:12 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Created reservations ['78128097-62f1-4f70-b41f-510c97d06809', '3d008117-20c2-431b-946e-19c3f1b63103', 'ead336f1-2a25-47a1-8325-8d17d1873741', 'c9789597-f80c-4227-8b91-cb76deb75430'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:13 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:13 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:13 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4" returned: 0 in 0.370s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.057s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baa897d-4679-45ab-9d29-b7868a6744cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d63c6f-3793-4568-b9ca-efa3a21079f4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd1865b-dc5c-4cad-ad98-710ccdb06c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Creating offline snapshot 492be41f-a36b-4ab9-9afd-ef3ca0e93db4 of volume 4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:43:13 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Volume volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 (25d63c6f-3793-4568-b9ca-efa3a21079f4): created successfully Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd1865b-dc5c-4cad-ad98-710ccdb06c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Flow 'volume_create_manager' (ed25448b-92d0-4c2f-b8e3-11ace1590244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[529ce65c-7c45-4cbd-88ee-620571ffb669]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:13 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fe8ecf0a-7eab-4546-91a9-60fdc5be71a2 tempest-VolumesTestJSON-2079620788 None] Created volume successfully. Nov 06 19:43:13 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b Nov 06 19:43:13 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:13 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.389s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:13 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Deleted volume successfully. Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cfa0b5c-457d-4f4d-ba39-715311725d4d tempest-VolumesActionsTest-1474028955 None] Lock "cinder-89ce9791-c45b-4905-8643-496d5d2f5abd-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:13 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b" returned: 0 in 0.446s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:13 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 1G Nov 06 19:43:13 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (fc0f4f24-7a73-4f3e-89b1-211bc5698b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01467962-39da-4420-a787-c156309085fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01467962-39da-4420-a787-c156309085fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824022078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21299b59-ac15-49c1-a45a-a7fb8a9e8d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:14Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9972b2-20fc-435e-80eb-837096ca121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9972b2-20fc-435e-80eb-837096ca121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943d4bbc-4b21-4f87-87ec-b92f2c6d6b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943d4bbc-4b21-4f87-87ec-b92f2c6d6b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21299b59-ac15-49c1-a45a-a7fb8a9e8d11', 'volume_name': 'volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bbdc94-e1bc-45d4-8f51-bbdbcc3d81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bbdc94-e1bc-45d4-8f51-bbdbcc3d81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b386937-c4fb-49be-aaf1-1dd794ec957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:13 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Volume 21299b59-ac15-49c1-a45a-a7fb8a9e8d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11', 'volume_size': 1} Nov 06 19:43:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:14 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 1G" returned: 0 in 0.471s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4399b10f-f95e-4fab-8b05-326ff9adea5b -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:14 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4399b10f-f95e-4fab-8b05-326ff9adea5b -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 Nov 06 19:43:14 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:14 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4399b10f-f95e-4fab-8b05-326ff9adea5b -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4" returned: 0 in 0.396s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:14 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 is being set with open permissions: ugo+rw Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:14 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 Nov 06 19:43:14 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Flow 'volume_create_manager' (1ed42407-8c45-4184-9c3a-eb549d30afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8fe048-7af8-4345-90ff-46fbaa82301b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8fe048-7af8-4345-90ff-46fbaa82301b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2008190132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc97099-2a12-4692-a619-80e40e978b84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83cc87ab06b142318bb532a5cbb13b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:15Z,use_quota=True,user_id='4f1196ad55a24253a999a8b36c2d4fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c0c858-c4fd-4be5-9895-6d24ed371155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c0c858-c4fd-4be5-9895-6d24ed371155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03265ee-60f0-4f48-9b61-1171b12b62bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03265ee-60f0-4f48-9b61-1171b12b62bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc97099-2a12-4692-a619-80e40e978b84', 'volume_name': 'volume-7bc97099-2a12-4692-a619-80e40e978b84', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd467b81-d6ea-43e7-b8a1-83b8b0266a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd467b81-d6ea-43e7-b8a1-83b8b0266a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc7502d-d45a-4977-8c3c-4943f4d206af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:14 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Volume 7bc97099-2a12-4692-a619-80e40e978b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc97099-2a12-4692-a619-80e40e978b84', 'volume_size': 1} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:14 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4" returned: 0 in 0.281s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:14 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.info Nov 06 19:43:14 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:15 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.info" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:15 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.info is being set with open permissions: ugo+rw Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:15 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.info Nov 06 19:43:15 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:15 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.info" returned: 0 in 0.240s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824022078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21299b59-ac15-49c1-a45a-a7fb8a9e8d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:14Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Creating volume 21299b59-ac15-49c1-a45a-a7fb8a9e8d11 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:15 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:15 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 1073741824 Nov 06 19:43:15 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:15 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cb15cdbd-dbf5-4b58-be98-08179b68d41c tempest-VolumeDependencyTests-1613485969 None] Create snapshot completed successfully Nov 06 19:43:15 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 1073741824" returned: 0 in 0.493s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:16 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 Nov 06 19:43:16 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:16 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11" returned: 0 in 0.270s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2008190132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc97099-2a12-4692-a619-80e40e978b84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83cc87ab06b142318bb532a5cbb13b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:15Z,use_quota=True,user_id='4f1196ad55a24253a999a8b36c2d4fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Creating volume 7bc97099-2a12-4692-a619-80e40e978b84 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:16 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b386937-c4fb-49be-aaf1-1dd794ec957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eea8ef-92c6-40fa-bb81-0bc826b18a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:16 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 1073741824 Nov 06 19:43:16 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:16 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Volume volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 (21299b59-ac15-49c1-a45a-a7fb8a9e8d11): created successfully Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eea8ef-92c6-40fa-bb81-0bc826b18a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (fc0f4f24-7a73-4f3e-89b1-211bc5698b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:16 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6a17fc36-010f-43b0-8c81-2a7fd75f1ff8 tempest-VolumesActionsTest-1893032717 None] Created volume successfully. Nov 06 19:43:16 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 1073741824" returned: 0 in 0.583s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:16 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 Nov 06 19:43:16 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:16 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Flow 'volume_create_manager' (c2361016-a652-44d4-bc58-202e6676a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a85d763-3d39-45c1-b9de-9096b1fcc48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a85d763-3d39-45c1-b9de-9096b1fcc48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1654401605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da09dc9b-983d-4507-8748-2fd3162d1f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f9176890174e77a71f215361542aa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=492be41f-a36b-4ab9-9afd-ef3ca0e93db4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:17Z,use_quota=True,user_id='d18752e5b4e44416bdb026b5112910ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9139960-720c-4c52-9ff8-4ed9cffe1be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9139960-720c-4c52-9ff8-4ed9cffe1be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b751694-5df7-42cd-bcc9-d26b7d1ecacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b751694-5df7-42cd-bcc9-d26b7d1ecacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da09dc9b-983d-4507-8748-2fd3162d1f48', 'volume_name': 'volume-da09dc9b-983d-4507-8748-2fd3162d1f48', 'volume_size': 1, 'snapshot_id': '492be41f-a36b-4ab9-9afd-ef3ca0e93db4'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f6874a-d5f8-4335-a367-4058168ba44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f6874a-d5f8-4335-a367-4058168ba44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d5eb1d-a730-4152-84a5-3f7a1b1bd880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:17 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Volume da09dc9b-983d-4507-8748-2fd3162d1f48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da09dc9b-983d-4507-8748-2fd3162d1f48', 'volume_size': 1, 'snapshot_id': '492be41f-a36b-4ab9-9afd-ef3ca0e93db4'} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-21299b59-ac15-49c1-a45a-a7fb8a9e8d11-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-21299b59-ac15-49c1-a45a-a7fb8a9e8d11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-quobyte-21299b59-ac15-49c1-a45a-a7fb8a9e8d11" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:17 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-21299b59-ac15-49c1-a45a-a7fb8a9e8d11" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84" returned: 0 in 0.436s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.121s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-quobyte-492be41f-a36b-4ab9-9afd-ef3ca0e93db4-da09dc9b-983d-4507-8748-2fd3162d1f48" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc7502d-d45a-4977-8c3c-4943f4d206af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc97099-2a12-4692-a619-80e40e978b84', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587501e6-1b2c-467a-980e-aa27492dbfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[374ab675-6ab1-45fb-bc4b-6812a16355a6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-492be41f-a36b-4ab9-9afd-ef3ca0e93db4-da09dc9b-983d-4507-8748-2fd3162d1f48" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Creating volume da09dc9b-983d-4507-8748-2fd3162d1f48 from snapshot 492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-quobyte-da09dc9b-983d-4507-8748-2fd3162d1f48" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:17 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Volume volume-7bc97099-2a12-4692-a619-80e40e978b84 (7bc97099-2a12-4692-a619-80e40e978b84): created successfully Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587501e6-1b2c-467a-980e-aa27492dbfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Flow 'volume_create_manager' (1ed42407-8c45-4184-9c3a-eb549d30afaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-da09dc9b-983d-4507-8748-2fd3162d1f48" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] snapshot: 492be41f-a36b-4ab9-9afd-ef3ca0e93db4, volume: da09dc9b-983d-4507-8748-2fd3162d1f48, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:43:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-404dd32c-12aa-4358-80b3-791be4e392ef tempest-VolumesTestJSON-2079620788 None] Created volume successfully. Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5903a55-6178-4bbc-9cfd-4a18ff7e24ec]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:17 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:17 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:17 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 Nov 06 19:43:17 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:17 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11" returned: 0 in 0.448s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:17 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11 Nov 06 19:43:17 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:17 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4" returned: 0 in 0.448s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4399b10f-f95e-4fab-8b05-326ff9adea5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b3aace-928e-491f-9708-6e3c85c869d3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:18 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b Nov 06 19:43:18 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:18 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21299b59-ac15-49c1-a45a-a7fb8a9e8d11" returned: 0 in 0.332s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-21299b59-ac15-49c1-a45a-a7fb8a9e8d11" released by "delete_volume" :: held 0.844s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Created reservations ['a83a24a4-d754-4220-bca3-32206d6be7ac', 'ce5aadfe-8b07-4389-9cb7-abdf669ae16c', '3e0f8eab-dd9a-4a5b-b7b8-ed9855eccb4a', '6499cd49-a80e-45c7-8496-6d880103ed2c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:18 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:18 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:18 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b" returned: 0 in 0.492s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:18 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 Nov 06 19:43:18 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:18 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.427s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:18 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Deleted volume successfully. Nov 06 19:43:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e7e6cc3e-6d4a-41d0-b502-52ff08de3bf0 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-21299b59-ac15-49c1-a45a-a7fb8a9e8d11-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (4d455e17-46f9-4241-b9d1-adae24d66c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a19dd7a-70ee-4945-b0d7-be3575175dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a19dd7a-70ee-4945-b0d7-be3575175dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387354409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f106afbf-50e4-4200-9019-6c5d9d455586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:19Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49306203-420d-4e83-bce2-c06f18b10850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49306203-420d-4e83-bce2-c06f18b10850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e9bb1c-20e8-4957-81ec-a5c8fafec713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e9bb1c-20e8-4957-81ec-a5c8fafec713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f106afbf-50e4-4200-9019-6c5d9d455586', 'volume_name': 'volume-f106afbf-50e4-4200-9019-6c5d9d455586', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bb54bb-7927-4e66-b3a4-fdf8e88b9a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bb54bb-7927-4e66-b3a4-fdf8e88b9a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6956cd7c-a306-442f-9baa-12edc60c0428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:19 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Volume f106afbf-50e4-4200-9019-6c5d9d455586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f106afbf-50e4-4200-9019-6c5d9d455586', 'volume_size': 1} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "cinder-7bc97099-2a12-4692-a619-80e40e978b84-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-7bc97099-2a12-4692-a619-80e40e978b84-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "cinder-quobyte-7bc97099-2a12-4692-a619-80e40e978b84" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-quobyte-7bc97099-2a12-4692-a619-80e40e978b84" acquired by "delete_volume" :: waited 0.039s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ce7c61-d077-4644-a098-6cc3632c2001]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:20 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 Nov 06 19:43:20 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:20 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84" returned: 0 in 0.691s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:20 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84 Nov 06 19:43:20 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:21 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7bc97099-2a12-4692-a619-80e40e978b84" returned: 0 in 0.497s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-quobyte-7bc97099-2a12-4692-a619-80e40e978b84" released by "delete_volume" :: held 1.291s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Created reservations ['8fd721e1-f5ef-4944-87b7-280049a92ed5', '0b8af6cf-697e-44d5-9308-6be72e450d70', '802b4b85-6729-414f-aae1-ffae00ab5326', '41937468-e43c-4c4d-80af-60f0440183c0'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:21 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:21 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Flow 'volume_create_manager' (c3df03a5-a18c-46dc-9e68-a7d2570b0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816b0d4f-a1fc-4547-8f39-94b8d7f78507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816b0d4f-a1fc-4547-8f39-94b8d7f78507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-533126034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97a272c-cc18-4c60-9320-49d6b89e60f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a365468d104bb3b3688a4c94d7ee6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:22Z,use_quota=True,user_id='fa6b7545d70e47398bc5d5f6ff1e00c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebcfb4e-f9bc-412a-839a-40221d1d5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebcfb4e-f9bc-412a-839a-40221d1d5569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ea5b4b-0386-44e0-88a4-939ae44d6bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ea5b4b-0386-44e0-88a4-939ae44d6bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97a272c-cc18-4c60-9320-49d6b89e60f7', 'volume_name': 'volume-c97a272c-cc18-4c60-9320-49d6b89e60f7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807c1168-925a-4406-bb0e-a519ffd54003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807c1168-925a-4406-bb0e-a519ffd54003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9a120e-acbf-470c-896d-f0813cabaf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:21 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Volume c97a272c-cc18-4c60-9320-49d6b89e60f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97a272c-cc18-4c60-9320-49d6b89e60f7', 'volume_size': 1} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:21 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.472s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Deleted volume successfully. Nov 06 19:43:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0b028991-fe06-4f7a-b08d-02ac0bb6a019 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-7bc97099-2a12-4692-a619-80e40e978b84-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "cinder-25d63c6f-3793-4568-b9ca-efa3a21079f4-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-25d63c6f-3793-4568-b9ca-efa3a21079f4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "cinder-quobyte-25d63c6f-3793-4568-b9ca-efa3a21079f4" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-quobyte-25d63c6f-3793-4568-b9ca-efa3a21079f4" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f511ba5c-642a-4b0b-b55b-87de0400dcfc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:22 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 Nov 06 19:43:22 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:22 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:23 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4 Nov 06 19:43:23 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:23 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25d63c6f-3793-4568-b9ca-efa3a21079f4" returned: 0 in 0.346s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-quobyte-25d63c6f-3793-4568-b9ca-efa3a21079f4" released by "delete_volume" :: held 0.990s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Created reservations ['aa5f04ff-004e-498f-8eec-7a365a849573', 'e99b4e1d-9518-4321-a7d6-e6f04a97012a', 'a5493b8a-d30d-477f-9a5e-40b86e832fa6', 'bfd4e9fe-ab01-418c-98d5-14854f381f6e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:23 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:23 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:23 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.368s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:23 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Deleted volume successfully. Nov 06 19:43:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-54c32688-e7b3-47e9-8c70-ace745064925 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-25d63c6f-3793-4568-b9ca-efa3a21079f4-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "cinder-ed100915-4a68-4c4f-b6d0-39d86b885241-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-ed100915-4a68-4c4f-b6d0-39d86b885241-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "cinder-quobyte-ed100915-4a68-4c4f-b6d0-39d86b885241" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-quobyte-ed100915-4a68-4c4f-b6d0-39d86b885241" acquired by "delete_volume" :: waited 0.036s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:24 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1680b6-c586-4e8b-811c-2c697ff66c8b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:25 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 Nov 06 19:43:25 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:25 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241" returned: 0 in 0.541s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:25 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241 Nov 06 19:43:25 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:25 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ed100915-4a68-4c4f-b6d0-39d86b885241" returned: 0 in 0.353s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-quobyte-ed100915-4a68-4c4f-b6d0-39d86b885241" released by "delete_volume" :: held 0.996s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Created reservations ['98aa9318-4027-4761-a2df-ad7c31b16747', 'cf0fe699-f1e1-440f-8231-31f4677df7b5', '018ac19f-f3c4-4d8c-bb54-4211c21fd120', '341b9edc-367b-4fd5-bc2a-2e565ef1b526'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:26 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:26 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:26 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48" returned: 0 in 7.778s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:43:26 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Converted 1024.00 MB image at 131.60 MB/s Nov 06 19:43:26 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 is being set with open permissions: ugo+rw Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:26 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 Nov 06 19:43:26 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:26 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.347s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Deleted volume successfully. Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4d244e87-9cf1-49e5-87a7-784b16702d31 tempest-VolumesTestJSON-2079620788 None] Lock "cinder-ed100915-4a68-4c4f-b6d0-39d86b885241-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:26 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-da09dc9b-983d-4507-8748-2fd3162d1f48" released by "_copy_volume_from_snapshot" :: held 9.084s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-492be41f-a36b-4ab9-9afd-ef3ca0e93db4-da09dc9b-983d-4507-8748-2fd3162d1f48" released by "_create_volume_from_snapshot" :: held 9.159s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.205s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.160s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387354409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f106afbf-50e4-4200-9019-6c5d9d455586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:19Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Creating volume f106afbf-50e4-4200-9019-6c5d9d455586 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:26 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:26 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 1073741824 Nov 06 19:43:26 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d5eb1d-a730-4152-84a5-3f7a1b1bd880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da09dc9b-983d-4507-8748-2fd3162d1f48', 'volume_size': 1, 'snapshot_id': '492be41f-a36b-4ab9-9afd-ef3ca0e93db4'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d3ad31-0c96-40be-b864-9bc532634f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:26 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Volume volume-da09dc9b-983d-4507-8748-2fd3162d1f48 (da09dc9b-983d-4507-8748-2fd3162d1f48): created successfully Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d3ad31-0c96-40be-b864-9bc532634f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Flow 'volume_create_manager' (c2361016-a652-44d4-bc58-202e6676a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c8297693-8d24-44a9-8a76-2743685ef510 tempest-VolumeDependencyTests-1613485969 None] Created volume successfully. Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-492be41f-a36b-4ab9-9afd-ef3ca0e93db4-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-492be41f-a36b-4ab9-9afd-ef3ca0e93db4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-quobyte-4399b10f-f95e-4fab-8b05-326ff9adea5b" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-4399b10f-f95e-4fab-8b05-326ff9adea5b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-quobyte-492be41f-a36b-4ab9-9afd-ef3ca0e93db4" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-492be41f-a36b-4ab9-9afd-ef3ca0e93db4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Deleting offline snapshot 492be41f-a36b-4ab9-9afd-ef3ca0e93db4 of volume 4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] snapshot_file for this snap is: volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[07649a17-f0b7-4076-bfb2-549fcb11f96e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:27 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 1073741824" returned: 0 in 0.484s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:27 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 Nov 06 19:43:27 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:27 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 Nov 06 19:43:27 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:27 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586" returned: 0 in 0.253s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.423s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-533126034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97a272c-cc18-4c60-9320-49d6b89e60f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a365468d104bb3b3688a4c94d7ee6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:22Z,use_quota=True,user_id='fa6b7545d70e47398bc5d5f6ff1e00c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Creating volume c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:27 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6956cd7c-a306-442f-9baa-12edc60c0428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f106afbf-50e4-4200-9019-6c5d9d455586', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72e261f-cb84-4495-b669-0de15e74dd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:27 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:27 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 1073741824 Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4" returned: 0 in 0.392s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4399b10f-f95e-4fab-8b05-326ff9adea5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:43:27 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:27 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Volume volume-f106afbf-50e4-4200-9019-6c5d9d455586 (f106afbf-50e4-4200-9019-6c5d9d455586): created successfully Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72e261f-cb84-4495-b669-0de15e74dd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (4d455e17-46f9-4241-b9d1-adae24d66c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2622fead-b00d-48b8-9a55-11c7038e9dfa]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:27 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b1742540-eca8-4d05-9c09-ea3d8391c58c tempest-VolumesActionsTest-1893032717 None] Created volume successfully. Nov 06 19:43:27 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b Nov 06 19:43:27 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:27 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 1073741824" returned: 0 in 0.474s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:27 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 Nov 06 19:43:27 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:28 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b" returned: 0 in 0.692s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-f106afbf-50e4-4200-9019-6c5d9d455586-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:28 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 Nov 06 19:43:28 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-f106afbf-50e4-4200-9019-6c5d9d455586-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-quobyte-f106afbf-50e4-4200-9019-6c5d9d455586" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:28 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7" returned: 0 in 0.400s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-f106afbf-50e4-4200-9019-6c5d9d455586" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9a120e-acbf-470c-896d-f0813cabaf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97a272c-cc18-4c60-9320-49d6b89e60f7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce9122e-a7cc-4273-8ad8-5f001fc7ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[436c3a57-9e7c-4141-9eee-f66488a7cd45]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:28 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Volume volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 (c97a272c-cc18-4c60-9320-49d6b89e60f7): created successfully Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce9122e-a7cc-4273-8ad8-5f001fc7ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Flow 'volume_create_manager' (c3df03a5-a18c-46dc-9e68-a7d2570b0f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0790e265-c766-45b0-99ca-eb5448352d50 tempest-VolumesCloneTest-1537672229 None] Created volume successfully. Nov 06 19:43:28 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 Nov 06 19:43:28 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:28 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4" returned: 0 in 0.403s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:28 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4 Nov 06 19:43:28 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:28 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586" returned: 0 in 0.414s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:28 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586 Nov 06 19:43:28 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:28 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b.492be41f-a36b-4ab9-9afd-ef3ca0e93db4" returned: 0 in 0.282s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-492be41f-a36b-4ab9-9afd-ef3ca0e93db4" released by "_delete_snapshot" :: held 1.913s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-4399b10f-f95e-4fab-8b05-326ff9adea5b" released by "delete_snapshot" :: held 1.942s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:28 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Created reservations ['867ac786-6227-4a9e-937c-2586a7f7c3c0', '94aaf376-a140-4ce0-8510-c836b4f84f78', '4c71224d-6256-4080-a631-ed1d73fafb7f', '1224cc69-ce7f-40f4-afab-c9121a03abba'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:29 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Delete snapshot completed successfully. Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f106afbf-50e4-4200-9019-6c5d9d455586" returned: 0 in 0.284s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c3424165-5891-44cb-825f-1262b553ab3b tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-492be41f-a36b-4ab9-9afd-ef3ca0e93db4-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-f106afbf-50e4-4200-9019-6c5d9d455586" released by "delete_volume" :: held 0.751s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Created reservations ['91d57171-dc39-4119-8790-96a2c8fae1eb', 'd918241e-50d8-406e-9efa-8f78c5a67d83', 'b4fc67cb-29f4-4b34-bd8f-2bb29cea97ed', 'f1f59bc5-e3e7-4549-9443-60f7a44d745d'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-4399b10f-f95e-4fab-8b05-326ff9adea5b-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-4399b10f-f95e-4fab-8b05-326ff9adea5b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-quobyte-4399b10f-f95e-4fab-8b05-326ff9adea5b" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-4399b10f-f95e-4fab-8b05-326ff9adea5b" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:29 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:29 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4657186d-a02e-41f3-9449-1338bd04e470]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:29 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:29 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.308s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:29 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Deleted volume successfully. Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-029665d7-1fba-4856-9947-7c8fab0c9fd4 tempest-VolumesActionsTest-1474028955 None] Lock "cinder-f106afbf-50e4-4200-9019-6c5d9d455586-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:29 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b" returned: 0 in 0.585s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:29 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b Nov 06 19:43:29 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:30 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4399b10f-f95e-4fab-8b05-326ff9adea5b" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-4399b10f-f95e-4fab-8b05-326ff9adea5b" released by "delete_volume" :: held 1.013s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (7a2667ac-66d8-4486-96d3-c1918ff592c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecb79cc-cadc-4360-99af-12d8a2e78ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecb79cc-cadc-4360-99af-12d8a2e78ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-180352745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1439ed69-f2b9-4e1f-8e75-3ab20a14e999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:30Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc89c636-c457-4a3d-ace6-e5fc3e77af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc89c636-c457-4a3d-ace6-e5fc3e77af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21407e1a-0c7b-401f-8556-dbc0dc1dd6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21407e1a-0c7b-401f-8556-dbc0dc1dd6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1439ed69-f2b9-4e1f-8e75-3ab20a14e999', 'volume_name': 'volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c15e858-4072-4825-90bb-9df740a6b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c15e858-4072-4825-90bb-9df740a6b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0752accf-bf42-4c00-89c6-8fc6d046797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Volume 1439ed69-f2b9-4e1f-8e75-3ab20a14e999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999', 'volume_size': 1} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-180352745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1439ed69-f2b9-4e1f-8e75-3ab20a14e999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:30Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Creating volume 1439ed69-f2b9-4e1f-8e75-3ab20a14e999 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:30 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:30 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 1073741824 Nov 06 19:43:30 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Flow 'volume_create_manager' (d5d9f375-5028-401c-ab7f-995624498bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c296f7-32b8-40f4-b1fb-7ab07a34c2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c296f7-32b8-40f4-b1fb-7ab07a34c2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1993551155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebec9103-39a5-424a-b33f-2e7d091bdda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a365468d104bb3b3688a4c94d7ee6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c97a272c-cc18-4c60-9320-49d6b89e60f7,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:30Z,use_quota=True,user_id='fa6b7545d70e47398bc5d5f6ff1e00c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6014af17-50fd-439d-b350-64ba9e8efeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6014af17-50fd-439d-b350-64ba9e8efeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494c447a-3b20-41aa-9d8f-5e9771fa8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Created reservations ['0ed17dc1-d83d-4fc5-8125-baf6da0b8de2', 'f5078127-1be0-48dd-9b67-f79e971424a0', 'b3856ab4-87a3-4f80-a873-4b25b746bf29', '07202a98-c018-4294-bbba-49d382b79e7b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494c447a-3b20-41aa-9d8f-5e9771fa8237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ebec9103-39a5-424a-b33f-2e7d091bdda6', 'volume_name': 'volume-ebec9103-39a5-424a-b33f-2e7d091bdda6', 'volume_size': 2, 'source_volid': 'c97a272c-cc18-4c60-9320-49d6b89e60f7', 'source_volstatus': 'available'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905ce801-7c8d-484a-8c18-085cb1362a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905ce801-7c8d-484a-8c18-085cb1362a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737edfc3-7ea4-4c45-b0b6-83a3aabd6f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Volume ebec9103-39a5-424a-b33f-2e7d091bdda6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ebec9103-39a5-424a-b33f-2e7d091bdda6', 'volume_size': 2, 'source_volid': 'c97a272c-cc18-4c60-9320-49d6b89e60f7', 'source_volstatus': 'available'} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:30 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:30 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:30 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Deleted volume successfully. Nov 06 19:43:30 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 1073741824" returned: 0 in 0.480s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d4e2bb37-eddc-4c1c-a7e7-24deb9c28379 tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-4399b10f-f95e-4fab-8b05-326ff9adea5b-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:30 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 Nov 06 19:43:30 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:31 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999" returned: 0 in 0.255s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.645s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:31 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Cloning volume c97a272c-cc18-4c60-9320-49d6b89e60f7 to volume ebec9103-39a5-424a-b33f-2e7d091bdda6 Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=143,cinder:UPDATE=188,cinder:INSERT=39,cinder:DELETE=14 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=120,cinder:UPDATE=176,cinder:INSERT=46,cinder:DELETE=18 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0752accf-bf42-4c00-89c6-8fc6d046797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83cec7b3-c1f7-4f30-a307-dc241c40d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Volume volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 (1439ed69-f2b9-4e1f-8e75-3ab20a14e999): created successfully Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83cec7b3-c1f7-4f30-a307-dc241c40d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (7a2667ac-66d8-4486-96d3-c1918ff592c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Creating offline snapshot 6a5c4224-e92c-494c-9faa-df27860c9f57 of volume c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:43:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cc421312-c395-426a-bd25-a96435e94038 tempest-VolumesActionsTest-1893032717 None] Created volume successfully. Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0294557-fad1-4776-8875-1fd1da89777c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-da09dc9b-983d-4507-8748-2fd3162d1f48-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-da09dc9b-983d-4507-8748-2fd3162d1f48-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:31 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 Nov 06 19:43:31 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "cinder-quobyte-da09dc9b-983d-4507-8748-2fd3162d1f48" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-da09dc9b-983d-4507-8748-2fd3162d1f48" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5388e429-f2b8-4e6f-a21d-a2c8d8770cbc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:31 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 Nov 06 19:43:31 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:31 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7" returned: 0 in 0.416s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:31 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 1G Nov 06 19:43:31 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:31 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:31 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48 Nov 06 19:43:31 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:32 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:32 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 1G" returned: 0 in 0.540s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-da09dc9b-983d-4507-8748-2fd3162d1f48" returned: 0 in 0.314s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:32 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 Nov 06 19:43:32 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-quobyte-da09dc9b-983d-4507-8748-2fd3162d1f48" released by "delete_volume" :: held 0.799s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e53edc04-caae-41a3-8139-7e0ae980fe8a tempest-GroupSnapshotsV319Test-600104628 None] Group tempest-GroupSnapshotsV319Test-Group-921350639: creating Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-1439ed69-f2b9-4e1f-8e75-3ab20a14e999-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e53edc04-caae-41a3-8139-7e0ae980fe8a tempest-GroupSnapshotsV319Test-600104628 None] Group tempest-GroupSnapshotsV319Test-Group-921350639: created successfully Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Lock "cinder-1439ed69-f2b9-4e1f-8e75-3ab20a14e999-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e53edc04-caae-41a3-8139-7e0ae980fe8a tempest-GroupSnapshotsV319Test-600104628 None] Create group completed successfully. Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Created reservations ['6d1f738f-929a-4c99-8b00-30306c058449', 'fbb03d34-0ba0-4938-a7a4-06e43e62349e', '18ddc5c3-783e-44dc-b4a7-d931d2d91f05', '0eeb6ad6-e39e-4977-9d08-739aa14054b3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Acquiring lock "cinder-quobyte-1439ed69-f2b9-4e1f-8e75-3ab20a14e999" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-1439ed69-f2b9-4e1f-8e75-3ab20a14e999" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf236c9-bce3-4568-8c28-c59106ec925a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:32 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:32 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:32 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57" returned: 0 in 0.365s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:32 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 is being set with open permissions: ugo+rw Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:32 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 Nov 06 19:43:32 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:32 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 Nov 06 19:43:32 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:32 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.286s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Deleted volume successfully. Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1362e205-1b50-41bd-b269-c00607b9ed2c tempest-VolumeDependencyTests-1613485969 None] Lock "cinder-da09dc9b-983d-4507-8748-2fd3162d1f48-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:32 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57" returned: 0 in 0.281s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:32 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999" returned: 0 in 0.494s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:32 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.info Nov 06 19:43:32 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:32 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999 Nov 06 19:43:32 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:33 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.info" returned: 0 in 0.296s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:33 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.info is being set with open permissions: ugo+rw Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:33 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1439ed69-f2b9-4e1f-8e75-3ab20a14e999" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:33 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.info Nov 06 19:43:33 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Lock "cinder-quobyte-1439ed69-f2b9-4e1f-8e75-3ab20a14e999" released by "delete_volume" :: held 0.835s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Created reservations ['d2542c8b-2a4f-4865-88fa-fd21ed20a35b', 'edfd5133-6aef-4be9-b1a7-e47ffc0fa7c6', 'd78e18ba-863f-4cd8-aba3-47ba411b25c7', '4667f193-6eed-4069-a2d8-e0c10b191e93'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:33 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:33 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:33 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.info" returned: 0 in 0.343s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "cinder-quobyte-ebec9103-39a5-424a-b33f-2e7d091bdda6" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-ebec9103-39a5-424a-b33f-2e7d091bdda6" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] snapshot: 6a5c4224-e92c-494c-9faa-df27860c9f57, volume: ebec9103-39a5-424a-b33f-2e7d091bdda6, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c89a6b-b7ad-447a-aefb-9771a40acaf4]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:33 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.357s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Deleted volume successfully. Nov 06 19:43:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-85c2e0c7-4404-4a96-ac9d-b4a04ab84c9f tempest-VolumesActionsTest-1474028955 None] Lock "cinder-1439ed69-f2b9-4e1f-8e75-3ab20a14e999-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:33 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 Nov 06 19:43:33 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:34 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57" returned: 0 in 0.629s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97a272c-cc18-4c60-9320-49d6b89e60f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[262fdcd1-578e-46d5-8f51-c6f4d96f8a3f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:34 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 Nov 06 19:43:34 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Flow 'volume_create_manager' (4db82665-cc76-4db3-bab2-86aeee524c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f98d1c8-c1fd-406e-9754-9253ab211690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f98d1c8-c1fd-406e-9754-9253ab211690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-737303204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=560f38cf-6bca-4a1d-afa9-bb7c203ed957,host='devstack@QuobyteHD#QuobyteHD',id=a23c4b53-56fc-407a-80a7-066649b91d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251b45e5c0ab416880f2536ea5ec2291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:34Z,use_quota=True,user_id='7f6f6aa8731641b28e0e7d6cdff2116a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e24ea106-ab74-4b42-be43-76e57f34fcf4),volume_type_id=e24ea106-ab74-4b42-be43-76e57f34fcf4)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ab295c-0fc0-484b-b68a-09d0399fc25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ab295c-0fc0-484b-b68a-09d0399fc25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ad3079-ed34-4ad4-a0e2-24d5ef844511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ad3079-ed34-4ad4-a0e2-24d5ef844511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23c4b53-56fc-407a-80a7-066649b91d65', 'volume_name': 'volume-a23c4b53-56fc-407a-80a7-066649b91d65', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6340255-bb29-4ae0-86d6-5878d657cc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6340255-bb29-4ae0-86d6-5878d657cc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca9bfd8-b893-4ac5-bffc-5f1ddfaa0eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Volume a23c4b53-56fc-407a-80a7-066649b91d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23c4b53-56fc-407a-80a7-066649b91d65', 'volume_size': 1} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (4825e255-e7fa-42c1-a5ee-ebdf3c9d4a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9e0569-9f8b-45ca-9853-2c8859cd5ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9e0569-9f8b-45ca-9853-2c8859cd5ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2143932671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f375dce-ee74-443b-a3c5-4e5380701e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:34Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5b7dce-8a6e-43f5-a59c-d855177c4358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5b7dce-8a6e-43f5-a59c-d855177c4358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77689999-9b68-4ba4-9a4c-e326d77e6ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77689999-9b68-4ba4-9a4c-e326d77e6ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f375dce-ee74-443b-a3c5-4e5380701e34', 'volume_name': 'volume-3f375dce-ee74-443b-a3c5-4e5380701e34', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b670b2b3-647d-4793-ae79-3ab97048f130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b670b2b3-647d-4793-ae79-3ab97048f130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22a097a-60b8-4381-9ea8-eb81309bf179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Volume 3f375dce-ee74-443b-a3c5-4e5380701e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f375dce-ee74-443b-a3c5-4e5380701e34', 'volume_size': 1} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:34 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7" returned: 0 in 0.407s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:43:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:34 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 Nov 06 19:43:34 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Flow 'volume_create_manager' (fef2273c-3cef-4ca6-b1a7-f886795c8a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c557509-6eca-45c7-919c-f636c8ae5c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c557509-6eca-45c7-919c-f636c8ae5c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132564597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ffd62d-04fc-4f28-8693-cdc0426b5653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f508bd1836945868b8cacc778768d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:37Z,use_quota=True,user_id='56f04b442eee4f819a471806a913e9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aed25cd-f743-4368-814d-d76406cd169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aed25cd-f743-4368-814d-d76406cd169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94994a42-9a90-41b2-a481-ee42705dedcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94994a42-9a90-41b2-a481-ee42705dedcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ffd62d-04fc-4f28-8693-cdc0426b5653', 'volume_name': 'volume-91ffd62d-04fc-4f28-8693-cdc0426b5653', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01041a13-1c32-48a0-9e82-e60f1fc535dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01041a13-1c32-48a0-9e82-e60f1fc535dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff88b13e-015e-4a6b-9e8f-3439d351e3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Volume 91ffd62d-04fc-4f28-8693-cdc0426b5653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ffd62d-04fc-4f28-8693-cdc0426b5653', 'volume_size': 1} Nov 06 19:43:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:41 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6" returned: 0 in 6.654s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:43:41 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Converted 1024.00 MB image at 153.88 MB/s Nov 06 19:43:41 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 is being set with open permissions: ugo+rw Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:41 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 Nov 06 19:43:41 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:41 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-ebec9103-39a5-424a-b33f-2e7d091bdda6" released by "_copy_volume_from_snapshot" :: held 8.048s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "cinder-quobyte-6a5c4224-e92c-494c-9faa-df27860c9f57" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-6a5c4224-e92c-494c-9faa-df27860c9f57" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Deleting offline snapshot 6a5c4224-e92c-494c-9faa-df27860c9f57 of volume c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] snapshot_file for this snap is: volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4141364-069b-414d-8828-ed47de7c7cf3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:41 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 Nov 06 19:43:41 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:42 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57" returned: 0 in 0.350s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97a272c-cc18-4c60-9320-49d6b89e60f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4160624-f116-480f-8e6d-fcecb6e6be89]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:42 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 Nov 06 19:43:42 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:42 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7" returned: 0 in 0.542s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:42 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 Nov 06 19:43:42 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:42 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57" returned: 0 in 0.353s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:43 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57 Nov 06 19:43:43 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:43 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7.6a5c4224-e92c-494c-9faa-df27860c9f57" returned: 0 in 0.244s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-6a5c4224-e92c-494c-9faa-df27860c9f57" released by "_delete_snapshot" :: held 1.579s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.128s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.738s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=560f38cf-6bca-4a1d-afa9-bb7c203ed957,created_at=2026-11-06T18:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-737303204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=560f38cf-6bca-4a1d-afa9-bb7c203ed957,host='devstack@QuobyteHD#QuobyteHD',id=a23c4b53-56fc-407a-80a7-066649b91d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251b45e5c0ab416880f2536ea5ec2291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:34Z,use_quota=True,user_id='7f6f6aa8731641b28e0e7d6cdff2116a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e24ea106-ab74-4b42-be43-76e57f34fcf4),volume_type_id=e24ea106-ab74-4b42-be43-76e57f34fcf4)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Creating volume a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:43 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:43 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 1073741824 Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737edfc3-7ea4-4c45-b0b6-83a3aabd6f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebec9103-39a5-424a-b33f-2e7d091bdda6', 'volume_size': 2, 'source_volid': 'c97a272c-cc18-4c60-9320-49d6b89e60f7', 'source_volstatus': 'available'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:43 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2123653-b8c7-4cd6-9ce7-3fa0985a35e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:43 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Volume volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 (ebec9103-39a5-424a-b33f-2e7d091bdda6): created successfully Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2123653-b8c7-4cd6-9ce7-3fa0985a35e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Flow 'volume_create_manager' (d5d9f375-5028-401c-ab7f-995624498bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-363be6a6-4ca6-4de9-a064-be713b0c8e79 tempest-VolumesCloneTest-1537672229 None] Created volume successfully. Nov 06 19:43:43 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 1073741824" returned: 0 in 0.401s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:43 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 Nov 06 19:43:43 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:44 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.365s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2143932671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f375dce-ee74-443b-a3c5-4e5380701e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad95a96b2f84691aa3d6adaea1f4acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:34Z,use_quota=True,user_id='8b42cf6015024e94be76e36c954f9fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Creating volume 3f375dce-ee74-443b-a3c5-4e5380701e34 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:44 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca9bfd8-b893-4ac5-bffc-5f1ddfaa0eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23c4b53-56fc-407a-80a7-066649b91d65', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:44 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 1073741824 Nov 06 19:43:44 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700ae15c-253c-4a15-941a-23414bfaddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:44 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Volume volume-a23c4b53-56fc-407a-80a7-066649b91d65 (a23c4b53-56fc-407a-80a7-066649b91d65): created successfully Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700ae15c-253c-4a15-941a-23414bfaddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Flow 'volume_create_manager' (4db82665-cc76-4db3-bab2-86aeee524c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2f69e611-74e9-43d3-a6e7-cc27377f8ce2 tempest-GroupSnapshotsV319Test-600104628 None] Created volume successfully. Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Acquiring lock "cinder-ebec9103-39a5-424a-b33f-2e7d091bdda6-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Lock "cinder-ebec9103-39a5-424a-b33f-2e7d091bdda6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Acquiring lock "cinder-quobyte-ebec9103-39a5-424a-b33f-2e7d091bdda6" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-ebec9103-39a5-424a-b33f-2e7d091bdda6" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12341bd-5803-4f9e-b2dc-59273e139db7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:44 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 1073741824" returned: 0 in 0.512s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:44 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 Nov 06 19:43:44 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:44 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 Nov 06 19:43:44 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:44 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34" returned: 0 in 0.241s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.257s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:44 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132564597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ffd62d-04fc-4f28-8693-cdc0426b5653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f508bd1836945868b8cacc778768d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:37Z,use_quota=True,user_id='56f04b442eee4f819a471806a913e9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Creating volume 91ffd62d-04fc-4f28-8693-cdc0426b5653 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:44 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:44 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 1073741824 Nov 06 19:43:44 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22a097a-60b8-4381-9ea8-eb81309bf179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f375dce-ee74-443b-a3c5-4e5380701e34', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd7cfd0-3f13-44da-9b86-a282fbaeeab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:44 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6 Nov 06 19:43:44 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:44 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Volume volume-3f375dce-ee74-443b-a3c5-4e5380701e34 (3f375dce-ee74-443b-a3c5-4e5380701e34): created successfully Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd7cfd0-3f13-44da-9b86-a282fbaeeab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Flow 'volume_create_manager' (4825e255-e7fa-42c1-a5ee-ebdf3c9d4a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4b342e1d-002f-4c4b-8574-188d70a13048 tempest-VolumesActionsTest-1893032717 None] Created volume successfully. Nov 06 19:43:45 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ebec9103-39a5-424a-b33f-2e7d091bdda6" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-ebec9103-39a5-424a-b33f-2e7d091bdda6" released by "delete_volume" :: held 0.749s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Created reservations ['320ec248-709c-4039-8473-988501e6a1c6', '6afe9ab1-6c7f-421c-857f-e23c6fb2e20b', '0ba40030-52c9-407f-9f2c-8eba7eb8622f', '27cb4279-20c6-45e7-a373-995cfd48d2e4'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:45 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:45 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:45 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 1073741824" returned: 0 in 0.608s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] GroupSnapshot 41dbe8f4-8649-4ae9-95a7-08d9e40ce796: creating. Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Group snapshot 41dbe8f4-8649-4ae9-95a7-08d9e40ce796: creating. {{(pid=86928) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:45 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 Nov 06 19:43:45 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:45 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "cinder-c97a272c-cc18-4c60-9320-49d6b89e60f7-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.342s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-c97a272c-cc18-4c60-9320-49d6b89e60f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Deleted volume successfully. Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9be5f457-6739-462c-9709-96bd672d630b tempest-VolumesCloneTest-1537672229 None] Lock "cinder-ebec9103-39a5-424a-b33f-2e7d091bdda6-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "cinder-quobyte-c97a272c-cc18-4c60-9320-49d6b89e60f7" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-c97a272c-cc18-4c60-9320-49d6b89e60f7" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "cinder-3f375dce-ee74-443b-a3c5-4e5380701e34-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-3f375dce-ee74-443b-a3c5-4e5380701e34-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c446b8a6-a78a-4734-b08d-6cebbe2c1c1f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:45 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653" returned: 0 in 0.327s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.308s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff88b13e-015e-4a6b-9e8f-3439d351e3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ffd62d-04fc-4f28-8693-cdc0426b5653', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c3871a-9ca6-423e-a068-57b15b9faca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "cinder-quobyte-3f375dce-ee74-443b-a3c5-4e5380701e34" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Creating offline snapshot ae004631-991b-4dbd-a50d-ba02971fd029 of volume a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:43:45 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Volume volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 (91ffd62d-04fc-4f28-8693-cdc0426b5653): created successfully Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c3871a-9ca6-423e-a068-57b15b9faca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Flow 'volume_create_manager' (fef2273c-3cef-4ca6-b1a7-f886795c8a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8fef7c-d2ea-4299-880b-f03530e174ec]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-quobyte-3f375dce-ee74-443b-a3c5-4e5380701e34" acquired by "delete_volume" :: waited 0.059s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:45 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 Nov 06 19:43:45 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4495b599-93b8-4760-8f18-871fb8f36b82]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-5be6b896-ee30-4065-a295-90be9c919cbc tempest-ProjectReaderTests-181301525 None] Created volume successfully. Nov 06 19:43:46 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 Nov 06 19:43:46 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:46 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 Nov 06 19:43:46 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:46 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:46 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7 Nov 06 19:43:46 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:46 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:46 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34" returned: 0 in 0.391s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:46 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 1G Nov 06 19:43:46 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:46 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34 Nov 06 19:43:46 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:46 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c97a272c-cc18-4c60-9320-49d6b89e60f7" returned: 0 in 0.267s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-quobyte-c97a272c-cc18-4c60-9320-49d6b89e60f7" released by "delete_volume" :: held 0.761s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Created reservations ['e50261e9-b89b-4fdc-81a5-6e567f4d1f3a', '74d52d91-6d1b-4ab7-81da-e0bc34c1ff8a', '7334370e-53e4-4dbc-bd97-3b6e6f48be34', '4b23ef28-86f7-4769-bef3-5d9ea603f878'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:46 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3f375dce-ee74-443b-a3c5-4e5380701e34" returned: 0 in 0.286s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:46 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-quobyte-3f375dce-ee74-443b-a3c5-4e5380701e34" released by "delete_volume" :: held 0.740s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:46 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Created reservations ['2f81be36-8ec9-45ad-bd7a-b307c6c27552', '5494f7fc-aced-48fa-9bab-bfaccefd6888', '684f07a4-8010-4724-bf66-c3ebc5efdb83', '4699f483-c4f3-4ac8-a6ab-9e9dcb4a82a9'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:46 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:46 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:46 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 1G" returned: 0 in 0.567s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a23c4b53-56fc-407a-80a7-066649b91d65 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:46 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:46 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:46 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a23c4b53-56fc-407a-80a7-066649b91d65 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 Nov 06 19:43:46 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Deleted volume successfully. Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d9d4bd21-9cd9-48f1-85ab-1fef6bd435a2 tempest-VolumesCloneTest-1537672229 None] Lock "cinder-c97a272c-cc18-4c60-9320-49d6b89e60f7-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:47 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.349s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Deleted volume successfully. Nov 06 19:43:47 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:47 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0a0e7fb5-8e2b-451f-865f-bbac37f08975 tempest-VolumesActionsTest-1893032717 None] Lock "cinder-3f375dce-ee74-443b-a3c5-4e5380701e34-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:47 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a23c4b53-56fc-407a-80a7-066649b91d65 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029" returned: 0 in 0.535s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:47 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:43:47 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.356s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:43:47 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:43:47 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Acquiring lock "cinder-91ffd62d-04fc-4f28-8693-cdc0426b5653-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Lock "cinder-91ffd62d-04fc-4f28-8693-cdc0426b5653-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Acquiring lock "cinder-quobyte-91ffd62d-04fc-4f28-8693-cdc0426b5653" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Lock "cinder-quobyte-91ffd62d-04fc-4f28-8693-cdc0426b5653" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:47 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029" returned: 0 in 0.328s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b35ea1-1a99-43d5-bc82-57b2197245d2]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:47 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.info Nov 06 19:43:47 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:47 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 Nov 06 19:43:47 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:48 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.info" returned: 0 in 0.324s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:48 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:48 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.info Nov 06 19:43:48 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:48 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653" returned: 0 in 0.515s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:48 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653 Nov 06 19:43:48 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:48 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.info" returned: 0 in 0.311s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-04bd96f0-571f-4685-848c-bb752fa594a1 tempest-GroupSnapshotsV319Test-600104628 None] group_snapshot 41dbe8f4-8649-4ae9-95a7-08d9e40ce796: created successfully Nov 06 19:43:48 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-91ffd62d-04fc-4f28-8693-cdc0426b5653" returned: 0 in 0.325s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Lock "cinder-quobyte-91ffd62d-04fc-4f28-8693-cdc0426b5653" released by "delete_volume" :: held 0.913s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Created reservations ['c3dc2b2e-c0ac-47a7-ba0b-f785b76de089', '7a8b1ecc-a30f-49a7-835d-e294dcb44cd3', '4f65bcd9-cdd3-4134-b78f-19f8d2f51e05', '8b8e6454-e7e5-4c31-bb28-aae78af779b8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:48 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:48 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:49 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.338s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Deleted volume successfully. Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fa347163-4692-4b0a-bdc9-e9e13d771d85 tempest-ProjectReaderTests-181301525 None] Lock "cinder-91ffd62d-04fc-4f28-8693-cdc0426b5653-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] group_snapshot 41dbe8f4-8649-4ae9-95a7-08d9e40ce796: deleting Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] group_snapshot 41dbe8f4-8649-4ae9-95a7-08d9e40ce796: deleting {{(pid=86928) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Acquiring lock "cinder-quobyte-a23c4b53-56fc-407a-80a7-066649b91d65" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Lock "cinder-quobyte-a23c4b53-56fc-407a-80a7-066649b91d65" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Acquiring lock "cinder-quobyte-ae004631-991b-4dbd-a50d-ba02971fd029" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Lock "cinder-quobyte-ae004631-991b-4dbd-a50d-ba02971fd029" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Deleting offline snapshot ae004631-991b-4dbd-a50d-ba02971fd029 of volume a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] snapshot_file for this snap is: volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9169627e-5b57-4ce5-85bc-bd7f4c24f387]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:49 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 Nov 06 19:43:49 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:50 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029" returned: 0 in 0.478s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a23c4b53-56fc-407a-80a7-066649b91d65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f492f-074c-4915-a94a-83a62b4cdcc9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:50 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 Nov 06 19:43:50 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Flow 'volume_create_manager' (92402d59-7237-440a-b3c6-d47c16006679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde01f9e-7077-4f40-8d8f-c65d385aa833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde01f9e-7077-4f40-8d8f-c65d385aa833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126804217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6038f60-36e8-4c29-a17e-90461d3a12e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f508bd1836945868b8cacc778768d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:51Z,use_quota=True,user_id='56f04b442eee4f819a471806a913e9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879213e-19d9-4bb6-a0f4-96cfebb6458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879213e-19d9-4bb6-a0f4-96cfebb6458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:50 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bce971-acc1-4790-9089-db7ae3d5bc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bce971-acc1-4790-9089-db7ae3d5bc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6038f60-36e8-4c29-a17e-90461d3a12e5', 'volume_name': 'volume-a6038f60-36e8-4c29-a17e-90461d3a12e5', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50200938-a58d-4c8e-a353-e477c543bead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50200938-a58d-4c8e-a353-e477c543bead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842ad4bd-2cd7-486d-9183-7fb29478281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Volume a6038f60-36e8-4c29-a17e-90461d3a12e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6038f60-36e8-4c29-a17e-90461d3a12e5', 'volume_size': 1} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126804217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6038f60-36e8-4c29-a17e-90461d3a12e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f508bd1836945868b8cacc778768d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:51Z,use_quota=True,user_id='56f04b442eee4f819a471806a913e9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Creating volume a6038f60-36e8-4c29-a17e-90461d3a12e5 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:50 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65" returned: 0 in 0.453s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:50 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 1073741824 Nov 06 19:43:50 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:50 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 Nov 06 19:43:50 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:51 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029" returned: 0 in 0.399s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:51 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029 Nov 06 19:43:51 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:51 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 1073741824" returned: 0 in 0.515s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:51 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 Nov 06 19:43:51 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:51 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65.ae004631-991b-4dbd-a50d-ba02971fd029" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Lock "cinder-quobyte-ae004631-991b-4dbd-a50d-ba02971fd029" released by "_delete_snapshot" :: held 1.882s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Lock "cinder-quobyte-a23c4b53-56fc-407a-80a7-066649b91d65" released by "delete_snapshot" :: held 1.909s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:51 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5" returned: 0 in 0.391s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:51 devstack cinder-volume[86928]: WARNING cinder.quota [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1515544078 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1515544078, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:43:51 devstack cinder-volume[86928]: WARNING cinder.quota [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1515544078 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1515544078, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842ad4bd-2cd7-486d-9183-7fb29478281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6038f60-36e8-4c29-a17e-90461d3a12e5', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471b01ff-8514-4141-b508-c91965d9cdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] Created reservations ['2e803901-7f2d-4497-bb9b-c306a3fdf01c', '888bc8ba-037f-4efa-a949-c2996f149420', '90bb3d4e-39e5-4b32-b2c4-f55659fe9fe1', '3e1de1f4-d643-499d-94b1-6872b1f0d8be'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Volume volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 (a6038f60-36e8-4c29-a17e-90461d3a12e5): created successfully Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471b01ff-8514-4141-b508-c91965d9cdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Flow 'volume_create_manager' (92402d59-7237-440a-b3c6-d47c16006679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-899818b9-b812-489e-bed5-308a91dfdd9e tempest-ProjectReaderTests-181301525 None] Created volume successfully. Nov 06 19:43:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3f951437-6dd6-437e-a292-f6ba7599a7bb tempest-GroupSnapshotsV319Test-600104628 None] group_snapshot 41dbe8f4-8649-4ae9-95a7-08d9e40ce796: deleted successfully Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Flow 'volume_create_manager' (75487d9d-cd37-48d0-bf75-60eae5425bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a35e9b-ff54-459e-8271-dddb9ea2e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a35e9b-ff54-459e-8271-dddb9ea2e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-371939809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fa1ec292ef4b74a2f7376d5e45a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:52Z,use_quota=True,user_id='177b7e7322e149339ecbc797d2a6cc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bc5616-abc3-4999-be58-58e460342cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bc5616-abc3-4999-be58-58e460342cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114b835c-18d3-4609-a999-e375fe2fedf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114b835c-18d3-4609-a999-e375fe2fedf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd', 'volume_name': 'volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd', 'volume_size': 2}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0eaad9-7f94-4704-8bd3-92d2bdadaa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0eaad9-7f94-4704-8bd3-92d2bdadaa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb164fe4-0f84-4531-a467-9d5b175fcd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Volume fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd', 'volume_size': 2} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-371939809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fa1ec292ef4b74a2f7376d5e45a8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:43:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:43:52Z,use_quota=True,user_id='177b7e7322e149339ecbc797d2a6cc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Creating volume fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:43:52 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd 2147483648 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:52 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd 2147483648 Nov 06 19:43:52 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Acquiring lock "cinder-quobyte-a23c4b53-56fc-407a-80a7-066649b91d65" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Lock "cinder-quobyte-a23c4b53-56fc-407a-80a7-066649b91d65" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0ec6fe-0ffd-4c2e-a938-92ae290deb91]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:52 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 Nov 06 19:43:52 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:52 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd 2147483648" returned: 0 in 0.621s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:52 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd Nov 06 19:43:52 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Acquiring lock "cinder-a6038f60-36e8-4c29-a17e-90461d3a12e5-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Lock "cinder-a6038f60-36e8-4c29-a17e-90461d3a12e5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Acquiring lock "cinder-quobyte-a6038f60-36e8-4c29-a17e-90461d3a12e5" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:52 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65" returned: 0 in 0.552s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Lock "cinder-quobyte-a6038f60-36e8-4c29-a17e-90461d3a12e5" acquired by "delete_volume" :: waited 0.049s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:52 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65 Nov 06 19:43:52 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76ec16b-cbe3-4992-98b3-5db59f1bdadc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:53 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd" returned: 0 in 0.337s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb164fe4-0f84-4531-a467-9d5b175fcd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd', 'volume_size': 2}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae3f692-a44b-4240-a8e8-d9f996ce5601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:43:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Volume volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd (fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd): created successfully Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae3f692-a44b-4240-a8e8-d9f996ce5601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Flow 'volume_create_manager' (75487d9d-cd37-48d0-bf75-60eae5425bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:43:53 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 Nov 06 19:43:53 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-25b029f7-5779-417d-bb35-ac5c45e327e1 tempest-VolumesCloneNegativeTest-1172530018 None] Created volume successfully. Nov 06 19:43:53 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a23c4b53-56fc-407a-80a7-066649b91d65" returned: 0 in 0.340s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Lock "cinder-quobyte-a23c4b53-56fc-407a-80a7-066649b91d65" released by "delete_volume" :: held 0.969s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Created reservations ['02191450-6ffc-4892-ad28-e05f6e1f5c26'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:53 devstack cinder-volume[86928]: WARNING cinder.quota [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1515544078 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1515544078, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Created reservations ['950d1799-f066-4074-9af2-e6d2ed38d1b3', '08db02d5-0e30-4e75-b5f5-0e3bd522172b', '3f9a9a7f-79e6-4fcd-911c-ecbc2be0362d', 'b9d6b5be-3fca-47c4-9e8c-439802256de1'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:53 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5" returned: 0 in 0.439s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:53 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5 Nov 06 19:43:53 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:53 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:53 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:53 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a6038f60-36e8-4c29-a17e-90461d3a12e5" returned: 0 in 0.302s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Lock "cinder-quobyte-a6038f60-36e8-4c29-a17e-90461d3a12e5" released by "delete_volume" :: held 0.814s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Created reservations ['1c77336a-10fc-4875-bed0-30b61c4e46dc', '10ab3d74-87c4-428b-89f3-2300e28a4fe7', '465b5180-f4db-479e-ae08-3f45842b3478', '042577d6-4d25-4152-936a-079fcaa13efd'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:53 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a267782a-dd17-4621-8aac-8cf1577ad22b tempest-GroupSnapshotsV319Test-600104628 None] Delete group completed successfully. Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:53 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:53 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:54 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.288s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Deleted volume successfully. Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-912ef6f9-8270-4335-93f2-cdeed52e7fd7 tempest-ProjectReaderTests-181301525 None] Lock "cinder-a6038f60-36e8-4c29-a17e-90461d3a12e5-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Acquiring lock "cinder-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "cinder-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Acquiring lock "cinder-quobyte-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "cinder-quobyte-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5575714-d588-4d68-a9e5-504969a7213b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:54 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd Nov 06 19:43:54 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:54 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd" returned: 0 in 0.527s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:54 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd Nov 06 19:43:54 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:55 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd" returned: 0 in 0.344s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "cinder-quobyte-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd" released by "delete_volume" :: held 0.926s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Created reservations ['6890c00e-2d15-4767-91a5-199298996974', 'd6657a2d-a00e-4dc1-b12d-bc493c427a37', 'edaa1b36-9a54-495c-9180-a07a59d6162e', '2d797c0d-d691-4c6d-b08a-f967d7f31f4c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:43:55 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:43:55 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:43:55 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.365s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:43:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Deleted volume successfully. Nov 06 19:43:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dd12d9d0-ab3e-49ec-9f26-9504b07c40b7 tempest-VolumesCloneNegativeTest-1172530018 None] Lock "cinder-fc5b85e3-e67b-4c86-8fb6-d7bfbd1ea2fd-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e1dba6eb-997e-4278-b388-5e72a6a7206d tempest-GroupsV320Test-1567666952 None] Group tempest-GroupsV320Test-Group-2025246302: creating Nov 06 19:44:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e1dba6eb-997e-4278-b388-5e72a6a7206d tempest-GroupsV320Test-1567666952 None] Group tempest-GroupsV320Test-Group-2025246302: created successfully Nov 06 19:44:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e1dba6eb-997e-4278-b388-5e72a6a7206d tempest-GroupsV320Test-1567666952 None] Create group completed successfully. Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Flow 'volume_create_manager' (005b4c22-b4d0-427f-8ae2-c24ea69ff008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390e8c0d-aa22-4414-9447-fcb09c8886b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390e8c0d-aa22-4414-9447-fcb09c8886b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1339181792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67215f0a-7d38-4443-919c-442cb89192e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7c37a365a646c4822ca79298471828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:06Z,use_quota=True,user_id='9742935d6abb4bff819fdf617eb5d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341c226d-8147-40c7-a863-f556136a2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341c226d-8147-40c7-a863-f556136a2c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48932fca-f992-4104-b4b8-49d4fa2e262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48932fca-f992-4104-b4b8-49d4fa2e262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67215f0a-7d38-4443-919c-442cb89192e4', 'volume_name': 'volume-67215f0a-7d38-4443-919c-442cb89192e4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3d78d4-0036-4131-9f7d-11ac3d910087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3d78d4-0036-4131-9f7d-11ac3d910087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28950dc1-4f48-4d2f-b235-5467f9cb53e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Volume 67215f0a-7d38-4443-919c-442cb89192e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67215f0a-7d38-4443-919c-442cb89192e4', 'volume_size': 1} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1339181792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67215f0a-7d38-4443-919c-442cb89192e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7c37a365a646c4822ca79298471828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:06Z,use_quota=True,user_id='9742935d6abb4bff819fdf617eb5d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Creating volume 67215f0a-7d38-4443-919c-442cb89192e4 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:05 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:06 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 1073741824 Nov 06 19:44:06 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Created reservations ['27b21009-eaaa-4ca7-bd25-299a97f46f8e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:06 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:06 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:06 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 1073741824" returned: 0 in 0.525s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:06 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 Nov 06 19:44:06 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:06 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b1d31ad4-5102-41c5-99e0-323226ecfef7 tempest-GroupsV320Test-1567666952 None] Delete group completed successfully. Nov 06 19:44:06 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28950dc1-4f48-4d2f-b235-5467f9cb53e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67215f0a-7d38-4443-919c-442cb89192e4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed40ec61-0bfd-47ed-808c-80b3353d7d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:06 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Volume volume-67215f0a-7d38-4443-919c-442cb89192e4 (67215f0a-7d38-4443-919c-442cb89192e4): created successfully Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed40ec61-0bfd-47ed-808c-80b3353d7d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Flow 'volume_create_manager' (005b4c22-b4d0-427f-8ae2-c24ea69ff008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-eb10a662-c439-42af-adeb-9f7fcef1643a tempest-VolumesTransfersV355Test-1155629500 None] Created volume successfully. Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Flow 'volume_create_manager' (c13f804d-ee4b-425b-8399-a2fcb4c8a680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11178bf-53d3-47e3-8c78-1ed0d15e4f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11178bf-53d3-47e3-8c78-1ed0d15e4f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-120090830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68e0cdf-1885-4467-a883-3512db6f9235,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fcff35586784b049a8393c6e3eeb0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:07Z,use_quota=True,user_id='65d671487837465e9eed61c61324a214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b872898f-9bca-40ee-b7ca-79cd2c63ca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b872898f-9bca-40ee-b7ca-79cd2c63ca11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb8aecb-62b5-427b-baff-e6a289606ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb8aecb-62b5-427b-baff-e6a289606ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68e0cdf-1885-4467-a883-3512db6f9235', 'volume_name': 'volume-c68e0cdf-1885-4467-a883-3512db6f9235', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1c8c50-41c5-42af-a019-417c7e2ba0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1c8c50-41c5-42af-a019-417c7e2ba0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44de3e6-72ef-46a2-a3d2-4f879e02e7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:06 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Volume c68e0cdf-1885-4467-a883-3512db6f9235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68e0cdf-1885-4467-a883-3512db6f9235', 'volume_size': 1} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-120090830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68e0cdf-1885-4467-a883-3512db6f9235,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fcff35586784b049a8393c6e3eeb0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:07Z,use_quota=True,user_id='65d671487837465e9eed61c61324a214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Creating volume c68e0cdf-1885-4467-a883-3512db6f9235 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:06 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:07 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 1073741824 Nov 06 19:44:07 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:07 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 1073741824" returned: 0 in 0.446s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:07 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 Nov 06 19:44:07 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:07 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44de3e6-72ef-46a2-a3d2-4f879e02e7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68e0cdf-1885-4467-a883-3512db6f9235', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c14a50-60ff-4848-aed7-a80344e6ca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:07 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Volume volume-c68e0cdf-1885-4467-a883-3512db6f9235 (c68e0cdf-1885-4467-a883-3512db6f9235): created successfully Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c14a50-60ff-4848-aed7-a80344e6ca63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Flow 'volume_create_manager' (c13f804d-ee4b-425b-8399-a2fcb4c8a680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:07 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fc3da755-bee2-464e-971a-bf80ed73b2a6 tempest-VolumesListTestJSON-1618208527 None] Created volume successfully. Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Flow 'volume_create_manager' (97083ab3-146c-4940-b982-365b43bddafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d438c6ce-15ba-4768-8d83-1e2b7c900fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d438c6ce-15ba-4768-8d83-1e2b7c900fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1000990831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955fe6fc-c943-4921-b4e4-1a1312a47be8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fcff35586784b049a8393c6e3eeb0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:08Z,use_quota=True,user_id='65d671487837465e9eed61c61324a214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2dfd36-03ba-46bf-adc3-8c72b6523101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2dfd36-03ba-46bf-adc3-8c72b6523101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c831b8-466f-4a8d-8d5d-28cd4a8e831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c831b8-466f-4a8d-8d5d-28cd4a8e831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955fe6fc-c943-4921-b4e4-1a1312a47be8', 'volume_name': 'volume-955fe6fc-c943-4921-b4e4-1a1312a47be8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e503a5d6-8540-4766-a1b5-e1b9f860eb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e503a5d6-8540-4766-a1b5-e1b9f860eb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470ab10f-be46-4f4f-95e9-68ab92506f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:08 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Volume 955fe6fc-c943-4921-b4e4-1a1312a47be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955fe6fc-c943-4921-b4e4-1a1312a47be8', 'volume_size': 1} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1000990831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955fe6fc-c943-4921-b4e4-1a1312a47be8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fcff35586784b049a8393c6e3eeb0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:08Z,use_quota=True,user_id='65d671487837465e9eed61c61324a214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Creating volume 955fe6fc-c943-4921-b4e4-1a1312a47be8 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:08 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:08 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 1073741824 Nov 06 19:44:08 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:09 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a584b23a-9220-40ac-bddd-1f7300207a98 tempest-VolumesTransfersV355Test-553509397 None] Transfer volume completed successfully. Nov 06 19:44:09 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 1073741824" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:09 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 Nov 06 19:44:09 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:09 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470ab10f-be46-4f4f-95e9-68ab92506f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955fe6fc-c943-4921-b4e4-1a1312a47be8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bead0eb-1114-4ba4-a831-97d9c8aacce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:09 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Volume volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 (955fe6fc-c943-4921-b4e4-1a1312a47be8): created successfully Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bead0eb-1114-4ba4-a831-97d9c8aacce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Flow 'volume_create_manager' (97083ab3-146c-4940-b982-365b43bddafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:09 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7f6d3389-aa33-4ebd-b4f4-453e982fdab4 tempest-VolumesListTestJSON-1618208527 None] Created volume successfully. Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Acquiring lock "cinder-67215f0a-7d38-4443-919c-442cb89192e4-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-67215f0a-7d38-4443-919c-442cb89192e4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Acquiring lock "cinder-quobyte-67215f0a-7d38-4443-919c-442cb89192e4" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-quobyte-67215f0a-7d38-4443-919c-442cb89192e4" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a6b0a-5ac8-4760-a613-2bdeb7ffd638]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:09 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 Nov 06 19:44:09 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:10 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4" returned: 0 in 0.389s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:10 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4 Nov 06 19:44:10 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:10 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-67215f0a-7d38-4443-919c-442cb89192e4" returned: 0 in 0.252s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-quobyte-67215f0a-7d38-4443-919c-442cb89192e4" released by "delete_volume" :: held 0.687s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Created reservations ['35c6debd-f857-4f18-b093-4500f5bf22ec', '5deb3d31-7088-4820-9c0e-6b4f7b40d14e', 'a81fb176-d6ef-465f-a124-82c717f595c7', 'e13f66c7-10d9-468c-807c-8ab99c4ec6a7'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:10 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:10 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:10 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.290s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Deleted volume successfully. Nov 06 19:44:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-18c1914b-ba47-49c9-beca-729826e53ca0 tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-67215f0a-7d38-4443-919c-442cb89192e4-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Flow 'volume_create_manager' (0b200857-20c3-4997-9e91-3df2b5e5cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53ca49e-dc8e-465a-aaaf-05a3c1e57d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53ca49e-dc8e-465a-aaaf-05a3c1e57d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1186607739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69298724-6aed-4a10-b5bd-3095ec8d4370,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fcff35586784b049a8393c6e3eeb0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:11Z,use_quota=True,user_id='65d671487837465e9eed61c61324a214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c839f5-ddb4-4966-862b-67be2fe322e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c839f5-ddb4-4966-862b-67be2fe322e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05821886-d02e-477e-9549-6f1941108ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05821886-d02e-477e-9549-6f1941108ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69298724-6aed-4a10-b5bd-3095ec8d4370', 'volume_name': 'volume-69298724-6aed-4a10-b5bd-3095ec8d4370', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fbeb45-a509-4038-9e74-5fe6d984876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fbeb45-a509-4038-9e74-5fe6d984876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff825a8-b3ae-40f0-a2d8-3b7056822bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Volume 69298724-6aed-4a10-b5bd-3095ec8d4370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69298724-6aed-4a10-b5bd-3095ec8d4370', 'volume_size': 1} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1186607739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69298724-6aed-4a10-b5bd-3095ec8d4370,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fcff35586784b049a8393c6e3eeb0cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:11Z,use_quota=True,user_id='65d671487837465e9eed61c61324a214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Creating volume 69298724-6aed-4a10-b5bd-3095ec8d4370 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:11 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:11 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 1073741824 Nov 06 19:44:11 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Flow 'volume_create_manager' (c24e32c4-d84d-4b13-b7d9-0254179e9233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372f1076-64cd-4acf-bf9d-373407e61031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372f1076-64cd-4acf-bf9d-373407e61031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1266003043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ca1702-ef53-48f4-bedc-f05cf27e8641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7c37a365a646c4822ca79298471828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:11Z,use_quota=True,user_id='9742935d6abb4bff819fdf617eb5d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5514b54-a50a-480d-bf36-d44a4a1ab978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5514b54-a50a-480d-bf36-d44a4a1ab978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c90e41d-02d3-4007-bcd8-9c7be1cddb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c90e41d-02d3-4007-bcd8-9c7be1cddb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ca1702-ef53-48f4-bedc-f05cf27e8641', 'volume_name': 'volume-25ca1702-ef53-48f4-bedc-f05cf27e8641', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb379e2f-44c2-41dd-82dc-9fed6b9e5cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb379e2f-44c2-41dd-82dc-9fed6b9e5cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec07cb2f-002f-4f7e-825d-40ad1354bcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Volume 25ca1702-ef53-48f4-bedc-f05cf27e8641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ca1702-ef53-48f4-bedc-f05cf27e8641', 'volume_size': 1} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:11 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 1073741824" returned: 0 in 0.439s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:11 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 Nov 06 19:44:11 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:12 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370" returned: 0 in 0.272s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1266003043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ca1702-ef53-48f4-bedc-f05cf27e8641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d7c37a365a646c4822ca79298471828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:11Z,use_quota=True,user_id='9742935d6abb4bff819fdf617eb5d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Creating volume 25ca1702-ef53-48f4-bedc-f05cf27e8641 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:12 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff825a8-b3ae-40f0-a2d8-3b7056822bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69298724-6aed-4a10-b5bd-3095ec8d4370', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:12 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 1073741824 Nov 06 19:44:12 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd91f40b-8483-4f20-8ffc-d1980d6e0647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:12 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Volume volume-69298724-6aed-4a10-b5bd-3095ec8d4370 (69298724-6aed-4a10-b5bd-3095ec8d4370): created successfully Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd91f40b-8483-4f20-8ffc-d1980d6e0647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Flow 'volume_create_manager' (0b200857-20c3-4997-9e91-3df2b5e5cbef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:12 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-50488295-c394-42bc-b2b9-6c6ba75679d9 tempest-VolumesListTestJSON-1618208527 None] Created volume successfully. Nov 06 19:44:12 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 1073741824" returned: 0 in 0.487s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:12 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 Nov 06 19:44:12 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:12 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641" returned: 0 in 0.258s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec07cb2f-002f-4f7e-825d-40ad1354bcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ca1702-ef53-48f4-bedc-f05cf27e8641', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75de1be9-555a-43d1-9cd6-e685a2c5a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:12 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Volume volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 (25ca1702-ef53-48f4-bedc-f05cf27e8641): created successfully Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75de1be9-555a-43d1-9cd6-e685a2c5a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Flow 'volume_create_manager' (c24e32c4-d84d-4b13-b7d9-0254179e9233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:12 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-75765981-5299-43cc-8cad-fa5c953952e4 tempest-VolumesTransfersV355Test-1155629500 None] Created volume successfully. Nov 06 19:44:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Acquiring lock "cinder-25ca1702-ef53-48f4-bedc-f05cf27e8641-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-25ca1702-ef53-48f4-bedc-f05cf27e8641-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Acquiring lock "cinder-quobyte-25ca1702-ef53-48f4-bedc-f05cf27e8641" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-quobyte-25ca1702-ef53-48f4-bedc-f05cf27e8641" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:13 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf9fd8-82dc-4d80-8242-ccdae79d1069]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:14 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 Nov 06 19:44:14 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:14 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641" returned: 0 in 0.393s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:14 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641 Nov 06 19:44:14 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:14 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-25ca1702-ef53-48f4-bedc-f05cf27e8641" returned: 0 in 0.284s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-quobyte-25ca1702-ef53-48f4-bedc-f05cf27e8641" released by "delete_volume" :: held 0.744s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Created reservations ['811aaf57-1ce5-4e2a-ba46-ce23b8033659', '5ecade16-265c-47d9-8a02-bfd22a363ddd', '36dfd864-cfac-4c61-8c72-7fd96d8663b7', '3a494f30-01ef-4ba1-9cf3-7bc524ec2b39'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:14 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:14 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:15 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.343s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:15 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:15 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Deleted volume successfully. Nov 06 19:44:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a70768a-f085-45c3-a576-32a59896a69a tempest-VolumesTransfersV355Test-1722805409 None] Lock "cinder-25ca1702-ef53-48f4-bedc-f05cf27e8641-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "cinder-69298724-6aed-4a10-b5bd-3095ec8d4370-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-69298724-6aed-4a10-b5bd-3095ec8d4370-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "cinder-quobyte-69298724-6aed-4a10-b5bd-3095ec8d4370" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-quobyte-69298724-6aed-4a10-b5bd-3095ec8d4370" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef9367-9c62-4283-a8a3-17400232e487]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:16 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 Nov 06 19:44:16 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:16 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370" returned: 0 in 0.405s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:16 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370 Nov 06 19:44:16 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:16 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-69298724-6aed-4a10-b5bd-3095ec8d4370" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-quobyte-69298724-6aed-4a10-b5bd-3095ec8d4370" released by "delete_volume" :: held 0.768s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Created reservations ['6b675960-e8c8-43af-9e3f-f2ad5a0aa1fd', 'bbc55ca5-0680-464f-8f29-154d6b126c2b', '1fe4a8c1-e338-4f88-8dd5-b916a5e75e0e', '310435ac-7175-49ae-8038-5ec3de69bce3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:17 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:17 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "cinder-955fe6fc-c943-4921-b4e4-1a1312a47be8-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-955fe6fc-c943-4921-b4e4-1a1312a47be8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "cinder-quobyte-955fe6fc-c943-4921-b4e4-1a1312a47be8" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:17 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.364s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Deleted volume successfully. Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-quobyte-955fe6fc-c943-4921-b4e4-1a1312a47be8" acquired by "delete_volume" :: waited 0.036s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cd369ce-1ceb-4289-aa5f-db6539a6d016 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-69298724-6aed-4a10-b5bd-3095ec8d4370-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bedfdc-c5b4-4c65-a706-7cb4b244d17c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:17 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 Nov 06 19:44:17 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:17 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8" returned: 0 in 0.394s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:17 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8 Nov 06 19:44:17 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:18 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-955fe6fc-c943-4921-b4e4-1a1312a47be8" returned: 0 in 0.305s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-quobyte-955fe6fc-c943-4921-b4e4-1a1312a47be8" released by "delete_volume" :: held 0.770s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Created reservations ['d8f5e930-f610-48ba-aab6-a3b9f8ad20fd', 'e03f8094-7e54-4dc8-874c-1d453ec500fe', 'c05d8f37-611f-4066-8039-8c5c16adc44e', '73d014ee-a9b3-4a24-9e41-f8e20bca73d5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:18 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:18 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "cinder-c68e0cdf-1885-4467-a883-3512db6f9235-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:18 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.324s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:18 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Deleted volume successfully. Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-c68e0cdf-1885-4467-a883-3512db6f9235-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-51b5c410-07a5-4139-980e-7a25070a699d tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-955fe6fc-c943-4921-b4e4-1a1312a47be8-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "cinder-quobyte-c68e0cdf-1885-4467-a883-3512db6f9235" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-quobyte-c68e0cdf-1885-4467-a883-3512db6f9235" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdfb0c7-0319-4bb7-a646-841bc41029cf]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:18 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 Nov 06 19:44:18 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:19 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235" returned: 0 in 0.489s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:19 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235 Nov 06 19:44:19 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:19 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c68e0cdf-1885-4467-a883-3512db6f9235" returned: 0 in 0.280s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-quobyte-c68e0cdf-1885-4467-a883-3512db6f9235" released by "delete_volume" :: held 0.834s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Created reservations ['34267b5e-bfaa-4cad-ba4d-b5ce8eef6a34', '6e08d438-545c-452b-9b38-9441b9807e62', 'e4f4376e-fdc6-424b-aae7-21fa1075fba7', '8785788f-6e3c-44d7-aa51-bb015b13e17d'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:19 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:19 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:20 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.277s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:20 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:20 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Deleted volume successfully. Nov 06 19:44:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3cf70980-21dc-4642-a9e9-fb3da5d89c25 tempest-VolumesListTestJSON-1618208527 None] Lock "cinder-c68e0cdf-1885-4467-a883-3512db6f9235-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Flow 'volume_create_manager' (15b0fb21-95fb-4d7c-8fd7-f4a62b84d857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128737d6-debf-4db9-bb8a-b7ed6960c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128737d6-debf-4db9-bb8a-b7ed6960c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1026608987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40b72bd-a2e5-45de-a61c-b3fc8c78216b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e9bab9b362412593d9daa7856f75a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:25Z,use_quota=True,user_id='4e8b649620f54a809f99d2ddabaa3cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc2028a-4d52-45f8-bb71-c635f17ff714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc2028a-4d52-45f8-bb71-c635f17ff714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa5b0b6-c2a2-49d3-abcb-e01ae42e0952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa5b0b6-c2a2-49d3-abcb-e01ae42e0952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40b72bd-a2e5-45de-a61c-b3fc8c78216b', 'volume_name': 'volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10acc6c3-4f30-4fef-ad2c-2c2c432e58b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10acc6c3-4f30-4fef-ad2c-2c2c432e58b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e40786-b53c-4925-a32f-9b9132faa108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b', 'volume_size': 1} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1026608987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40b72bd-a2e5-45de-a61c-b3fc8c78216b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e9bab9b362412593d9daa7856f75a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:25Z,use_quota=True,user_id='4e8b649620f54a809f99d2ddabaa3cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Creating volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:25 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:25 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b 1073741824 Nov 06 19:44:25 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Flow 'volume_create_manager' (680228b2-c9a9-4b41-b171-4c1f767e72d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82397205-a806-4105-b4e9-9cacfd38716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82397205-a806-4105-b4e9-9cacfd38716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-961978993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243a99ab-e0dc-43ba-8d0f-99711e2f5560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab30babbb5e4c97851cb855763c9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:25Z,use_quota=True,user_id='88807881f87c4af899e81119fcb9deeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c63eb13-70a8-46fb-872e-188008bbf7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c63eb13-70a8-46fb-872e-188008bbf7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2a7a36-2395-4dc2-afa5-d865fb0a34ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2a7a36-2395-4dc2-afa5-d865fb0a34ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243a99ab-e0dc-43ba-8d0f-99711e2f5560', 'volume_name': 'volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabdfd97-5973-4230-b660-dcc27f2c974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabdfd97-5973-4230-b660-dcc27f2c974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4100630-f8c3-47d4-bc97-96fac33675c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Volume 243a99ab-e0dc-43ba-8d0f-99711e2f5560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560', 'volume_size': 1} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:25 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b 1073741824" returned: 0 in 0.441s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:25 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b Nov 06 19:44:25 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:26 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-961978993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243a99ab-e0dc-43ba-8d0f-99711e2f5560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab30babbb5e4c97851cb855763c9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:25Z,use_quota=True,user_id='88807881f87c4af899e81119fcb9deeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Creating volume 243a99ab-e0dc-43ba-8d0f-99711e2f5560 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:26 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e40786-b53c-4925-a32f-9b9132faa108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a23252-11ac-4525-9bee-0311e174049f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:26 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 1073741824 Nov 06 19:44:26 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:26 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Volume volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b (e40b72bd-a2e5-45de-a61c-b3fc8c78216b): created successfully Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a23252-11ac-4525-9bee-0311e174049f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Flow 'volume_create_manager' (15b0fb21-95fb-4d7c-8fd7-f4a62b84d857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3cf2c684-9b66-4001-8454-b01cfd68d964 tempest-VolumesSnapshotListTestJSON-770387530 None] Created volume successfully. Nov 06 19:44:26 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 1073741824" returned: 0 in 0.470s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:26 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 Nov 06 19:44:26 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:26 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4100630-f8c3-47d4-bc97-96fac33675c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9492b58f-0552-45b1-bb91-55f49070ddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:26 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Volume volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 (243a99ab-e0dc-43ba-8d0f-99711e2f5560): created successfully Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9492b58f-0552-45b1-bb91-55f49070ddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Flow 'volume_create_manager' (680228b2-c9a9-4b41-b171-4c1f767e72d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-155ceed5-85ff-4608-b3ab-1c06eb7c47ac tempest-VolumesTransfersV357Test-1589427652 None] Created volume successfully. Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Creating offline snapshot 050584db-dbd3-4bfa-8f6b-74fc95666e44 of volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1277b77-c28a-4ea5-86f8-7625b32a6d7c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:27 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b Nov 06 19:44:27 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:27 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" returned: 0 in 0.420s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:27 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 1G Nov 06 19:44:27 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Flow 'volume_create_manager' (18ad2018-0442-4331-a720-2923cc463403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa4edfd-b1f2-4fca-99b9-22709da34574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa4edfd-b1f2-4fca-99b9-22709da34574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1110068017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cffcb050a6b485b8423dba26aae06bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:28Z,use_quota=True,user_id='3b94e40094204b9fa5c274a80e90a38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b97dad9-5a50-4f03-951d-210f2efa0a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b97dad9-5a50-4f03-951d-210f2efa0a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b841447c-5cd5-43e1-a239-11073ab80772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b841447c-5cd5-43e1-a239-11073ab80772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be', 'volume_name': 'volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2b40a2-6eba-42e3-b525-ac7f5661e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:27 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2b40a2-6eba-42e3-b525-ac7f5661e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa751705-8584-4ccc-b7c9-f1ae50ba5424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:28 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Volume 52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be', 'volume_size': 1} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a2e2ceba-721f-49aa-954f-f2e9e775223c tempest-VolumesTransfersV357Test-1935127683 None] Transfer volume completed successfully. Nov 06 19:44:28 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 1G" returned: 0 in 0.440s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:28 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 Nov 06 19:44:28 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:28 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:28 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 is being set with open permissions: ugo+rw Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:28 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 Nov 06 19:44:28 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Acquiring lock "cinder-243a99ab-e0dc-43ba-8d0f-99711e2f5560-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-243a99ab-e0dc-43ba-8d0f-99711e2f5560-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Acquiring lock "cinder-quobyte-243a99ab-e0dc-43ba-8d0f-99711e2f5560" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-quobyte-243a99ab-e0dc-43ba-8d0f-99711e2f5560" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ef2628-4a5c-4796-8d9c-f41715869342]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:28 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44" returned: 0 in 0.272s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:28 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.info Nov 06 19:44:28 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:28 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 Nov 06 19:44:28 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:29 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.info" returned: 0 in 0.257s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:29 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.info is being set with open permissions: ugo+rw Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:29 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.info Nov 06 19:44:29 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:29 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560" returned: 0 in 0.382s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:29 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560 Nov 06 19:44:29 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:29 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.info" returned: 0 in 0.244s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1110068017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cffcb050a6b485b8423dba26aae06bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:28Z,use_quota=True,user_id='3b94e40094204b9fa5c274a80e90a38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Creating volume 52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:29 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:29 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-243a99ab-e0dc-43ba-8d0f-99711e2f5560" returned: 0 in 0.264s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:29 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be 1073741824 Nov 06 19:44:29 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-quobyte-243a99ab-e0dc-43ba-8d0f-99711e2f5560" released by "delete_volume" :: held 0.709s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-62deac0c-9bca-40dd-a86e-ced97dd1646a tempest-VolumesSnapshotListTestJSON-770387530 None] Create snapshot completed successfully Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Created reservations ['6b2e0b70-0304-4211-aeec-8f057367fa7f', '720140e7-6098-4adf-a1c6-4fe82117718a', '2eb34d5a-b6fa-4e0b-bcc7-a947ad11a749', 'ac72ce0a-4379-4b5b-b4f7-65cb0026e1e8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:29 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:29 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:29 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.292s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Deleted volume successfully. Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-77a0a7cb-4eb3-4172-94ae-1b162f66f3c2 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-243a99ab-e0dc-43ba-8d0f-99711e2f5560-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:29 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be 1073741824" returned: 0 in 0.511s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:30 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be Nov 06 19:44:30 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:30 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa751705-8584-4ccc-b7c9-f1ae50ba5424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87321552-d820-42c7-ab45-6ed503c92f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Volume volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be (52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be): created successfully Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87321552-d820-42c7-ab45-6ed503c92f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Flow 'volume_create_manager' (18ad2018-0442-4331-a720-2923cc463403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f72ba390-1c83-4c8c-9b34-88b3d1c7630a tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Created volume successfully. Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Flow 'volume_create_manager' (296ccee2-79a2-4d63-9176-e642fabdc327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8d80fc-59fb-4bcf-8189-0d0eaaf179fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8d80fc-59fb-4bcf-8189-0d0eaaf179fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1115039085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ea281b-1a44-43cd-ab64-5c0ca1f0783b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab30babbb5e4c97851cb855763c9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:30Z,use_quota=True,user_id='88807881f87c4af899e81119fcb9deeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147afdd3-ee37-40d0-94d3-4f530e95dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147afdd3-ee37-40d0-94d3-4f530e95dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6946dcc0-7d76-4b22-b9b3-4a0e2415841a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6946dcc0-7d76-4b22-b9b3-4a0e2415841a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ea281b-1a44-43cd-ab64-5c0ca1f0783b', 'volume_name': 'volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44dec3f-e258-4ead-bd7b-a90f45943158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44dec3f-e258-4ead-bd7b-a90f45943158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b0e82b-8749-4ea5-9056-d31e3b9271ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Volume 51ea281b-1a44-43cd-ab64-5c0ca1f0783b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b', 'volume_size': 1} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1115039085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ea281b-1a44-43cd-ab64-5c0ca1f0783b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab30babbb5e4c97851cb855763c9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:30Z,use_quota=True,user_id='88807881f87c4af899e81119fcb9deeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Creating volume 51ea281b-1a44-43cd-ab64-5c0ca1f0783b {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:30 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:30 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b 1073741824 Nov 06 19:44:30 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:30 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b 1073741824" returned: 0 in 0.412s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:30 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b Nov 06 19:44:30 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:31 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b" returned: 0 in 0.251s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.466s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Creating offline snapshot 1cbbd9d6-34e3-4aca-b277-5de3889f0836 of volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b0e82b-8749-4ea5-9056-d31e3b9271ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af3b651-d595-4688-af15-e71558023869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[32417c6f-0c3f-41bc-9405-41f06e62488a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Volume volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b (51ea281b-1a44-43cd-ab64-5c0ca1f0783b): created successfully Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af3b651-d595-4688-af15-e71558023869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Flow 'volume_create_manager' (296ccee2-79a2-4d63-9176-e642fabdc327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=189,cinder:SELECT=127,cinder:INSERT=38,cinder:DELETE=15 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:44:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-df79a994-e95e-435d-96d5-495a85cbd56f tempest-VolumesTransfersV357Test-1589427652 None] Created volume successfully. Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=144,cinder:UPDATE=180,cinder:DELETE=16,cinder:INSERT=46 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:44:31 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 Nov 06 19:44:31 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:31 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44" returned: 0 in 0.427s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:31 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 1G Nov 06 19:44:31 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Acquiring lock "cinder-51ea281b-1a44-43cd-ab64-5c0ca1f0783b-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-51ea281b-1a44-43cd-ab64-5c0ca1f0783b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Acquiring lock "cinder-quobyte-51ea281b-1a44-43cd-ab64-5c0ca1f0783b" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-quobyte-51ea281b-1a44-43cd-ab64-5c0ca1f0783b" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed2e371-e5a3-4ef9-abfd-9b5b473cf657]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:31 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b Nov 06 19:44:31 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:32 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 1G" returned: 0 in 0.554s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:32 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 Nov 06 19:44:32 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:32 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Acquiring lock "cinder-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "cinder-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:32 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b Nov 06 19:44:32 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Acquiring lock "cinder-quobyte-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "cinder-quobyte-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb1f776-1e40-40c9-b08d-6e381bd3e3e2]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:32 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836" returned: 0 in 0.315s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:32 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 is being set with open permissions: ugo+rw Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:32 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be Nov 06 19:44:32 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:32 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 Nov 06 19:44:32 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:32 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-51ea281b-1a44-43cd-ab64-5c0ca1f0783b" returned: 0 in 0.314s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-quobyte-51ea281b-1a44-43cd-ab64-5c0ca1f0783b" released by "delete_volume" :: held 0.799s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Created reservations ['f807fe9a-412c-430b-a39a-a145bc982efe', 'de19166d-1c19-4b14-b746-f08368551466', 'f6d5200a-5cf6-4733-a4e6-3fdc0ecc1ff7', 'eeed6062-b3b4-41eb-81dd-d909b31d0172'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:32 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:32 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:32 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836" returned: 0 in 0.276s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:32 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.701s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be" returned: 0 in 0.454s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-18ca9f22-3246-40bb-bedd-7028827a1981 tempest-VolumesSnapshotListTestJSON-770387530 None] Create snapshot completed successfully Nov 06 19:44:32 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be Nov 06 19:44:32 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:33 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Deleted volume successfully. Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f51e8c70-24e0-48b7-bc6e-87e8686e81d3 tempest-VolumesTransfersV357Test-738094382 None] Lock "cinder-51ea281b-1a44-43cd-ab64-5c0ca1f0783b-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:33 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "cinder-quobyte-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be" released by "delete_volume" :: held 0.796s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Created reservations ['bb0298c9-f16a-4b0f-a3fe-c7dcb03bda6b', '743723f1-82f7-4390-91ac-233fd70a58db', '4469069f-8bc9-4233-9194-7c6fbaad2860', '2caa1e24-da07-462e-8a01-77e0295b9edb'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:33 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:33 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:33 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.267s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Deleted volume successfully. Nov 06 19:44:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8a8ba879-fd26-43e4-938c-f641e586c1c1 tempest-VolumeQuotasNegativeTestJSON-1629099160 None] Lock "cinder-52bc0b16-4cc0-4a56-a2ce-2b7e6e65e4be-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Creating offline snapshot 32150ebc-d38e-4c9a-b8fe-77cfb908257d of volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0291f-1239-4ede-9f62-7eab5e88e709]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:34 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 Nov 06 19:44:34 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:34 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836" returned: 0 in 0.389s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:34 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d 1G Nov 06 19:44:34 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:35 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d 1G" returned: 0 in 0.666s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:35 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d Nov 06 19:44:35 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:35 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d" returned: 0 in 0.333s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:35 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d is being set with open permissions: ugo+rw Nov 06 19:44:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:35 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d Nov 06 19:44:35 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:35 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d" returned: 0 in 0.304s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-162c0e4f-9216-4e29-9191-5c1b171a0794 tempest-VolumesSnapshotListTestJSON-770387530 None] Create snapshot completed successfully Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-32150ebc-d38e-4c9a-b8fe-77cfb908257d-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-32150ebc-d38e-4c9a-b8fe-77cfb908257d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-quobyte-32150ebc-d38e-4c9a-b8fe-77cfb908257d" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-32150ebc-d38e-4c9a-b8fe-77cfb908257d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Deleting offline snapshot 32150ebc-d38e-4c9a-b8fe-77cfb908257d of volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] snapshot_file for this snap is: volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5642a829-de12-42ca-90c9-a3438e81265f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:37 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d Nov 06 19:44:37 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:37 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d" returned: 0 in 0.409s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f194f9c-1010-44fa-b4b9-5079e5ad9311]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:38 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 Nov 06 19:44:38 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:38 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836" returned: 0 in 0.411s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:38 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d Nov 06 19:44:38 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:38 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d" returned: 0 in 0.491s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:38 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d Nov 06 19:44:38 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:39 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.32150ebc-d38e-4c9a-b8fe-77cfb908257d" returned: 0 in 0.286s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-32150ebc-d38e-4c9a-b8fe-77cfb908257d" released by "_delete_snapshot" :: held 1.738s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" released by "delete_snapshot" :: held 1.762s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Created reservations ['58c19a39-b3ef-47b0-b399-bb9438bf3106', '7bfddcd2-3e45-4f7f-90ed-79b7716d8fd2', '1c17a9ed-4dc4-4c49-9b50-a5da323f887d', '3c4439a3-421c-44d0-bda5-16868a0054c1'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Delete snapshot completed successfully. Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d9db916-4492-4186-acc8-5db7e1e3daaa tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-32150ebc-d38e-4c9a-b8fe-77cfb908257d-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-1cbbd9d6-34e3-4aca-b277-5de3889f0836-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-1cbbd9d6-34e3-4aca-b277-5de3889f0836-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-quobyte-1cbbd9d6-34e3-4aca-b277-5de3889f0836" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-1cbbd9d6-34e3-4aca-b277-5de3889f0836" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Deleting offline snapshot 1cbbd9d6-34e3-4aca-b277-5de3889f0836 of volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] snapshot_file for this snap is: volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[01179073-9732-445f-a553-d6b5f98f247b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:39 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 Nov 06 19:44:39 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:40 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836" returned: 0 in 0.444s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b85ea4-bb1a-45a2-882b-c88e11ce6db8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:40 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 Nov 06 19:44:40 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:40 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44" returned: 0 in 0.433s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:40 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 Nov 06 19:44:40 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Flow 'volume_create_manager' (57c208cc-4cd9-4e70-ba6a-c459deae0d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c492f36b-0f4b-48de-9afc-a9426aa266aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c492f36b-0f4b-48de-9afc-a9426aa266aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-609963952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca32436061a7463880863562b3e1ffa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:41Z,use_quota=True,user_id='22bcd70cb6254396a4024d88dbcbcda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8550ef-49bc-4a49-89d1-8aaa6ba060f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8550ef-49bc-4a49-89d1-8aaa6ba060f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c899e3-817a-4b00-a51b-976bd942fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:40 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c899e3-817a-4b00-a51b-976bd942fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f', 'volume_name': 'volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40942d93-45e1-42b3-951e-7e460ef0fb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40942d93-45e1-42b3-951e-7e460ef0fb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a71f3f-6de3-435c-aedd-def42a8ac0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:41 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Volume d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Trying to clone d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:44:41 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836" returned: 0 in 0.482s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:41 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836 Nov 06 19:44:41 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:41 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:44:41 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Image download 20.69 MB at 20.69 MB/s Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.1cbbd9d6-34e3-4aca-b277-5de3889f0836" returned: 0 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-1cbbd9d6-34e3-4aca-b277-5de3889f0836" released by "_delete_snapshot" :: held 1.805s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" released by "delete_snapshot" :: held 1.837s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb0c424-888b-42d8-9fce-065057f5aa21]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Created reservations ['e39e659d-89a9-4eff-bffc-510a13c4b40d', '54dc386f-bac5-494a-a19c-b0ba597dbee2', '3a1bf867-5f64-42c4-8d28-74dc8b57317e', '0bbaaeae-ee3a-443a-9dc3-b0998a5249e9'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:41 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD Nov 06 19:44:41 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:41 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Delete snapshot completed successfully. Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7007ea8-7400-45e1-98ae-7760224c3bfd tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-1cbbd9d6-34e3-4aca-b277-5de3889f0836-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-050584db-dbd3-4bfa-8f6b-74fc95666e44-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-050584db-dbd3-4bfa-8f6b-74fc95666e44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-quobyte-050584db-dbd3-4bfa-8f6b-74fc95666e44" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-050584db-dbd3-4bfa-8f6b-74fc95666e44" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Deleting offline snapshot 050584db-dbd3-4bfa-8f6b-74fc95666e44 of volume e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] snapshot_file for this snap is: volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:44:41 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 is fetched for user 22bcd70cb6254396a4024d88dbcbcda7. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ad1f58-66c5-4457-a826-d618349d60f8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcfc23d-3d31-4dbf-bc00-063b5ee5fe50]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:42 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 Nov 06 19:44:42 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:42 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD Nov 06 19:44:42 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:42 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:42 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-609963952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca32436061a7463880863562b3e1ffa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:41Z,use_quota=True,user_id='22bcd70cb6254396a4024d88dbcbcda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Creating volume d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:42 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7446e59e-24d5-4195-b6e9-ab5f28a5277a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:42 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 1073741824 Nov 06 19:44:42 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:42 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b Nov 06 19:44:42 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:42 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" returned: 0 in 0.426s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:42 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 Nov 06 19:44:42 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:42 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 1073741824" returned: 0 in 0.535s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:42 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f Nov 06 19:44:42 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:43 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" returned: 0 in 0.282s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Attempting download of 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:44:43 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44" returned: 0 in 0.453s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:43 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44 Nov 06 19:44:43 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f5ad2c-d0e0-44cb-88e3-e01bc6f35699]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_utoe98zf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:43 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_utoe98zf Nov 06 19:44:43 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:43 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b.050584db-dbd3-4bfa-8f6b-74fc95666e44" returned: 0 in 0.286s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-050584db-dbd3-4bfa-8f6b-74fc95666e44" released by "_delete_snapshot" :: held 1.777s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" released by "delete_snapshot" :: held 1.806s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:43 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_utoe98zf" returned: 0 in 0.363s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_utoe98zf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Created reservations ['a3d10ac3-eedd-4558-ba76-9aa5c2c15f71', 'e0b7e41b-8102-44a6-bdd5-df3280a49ec3', '045c0d04-f7e6-43bc-bc8c-3b3349da8d99', '921a2fdd-d8c3-4e24-a0a7-6814f5155a58'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Delete snapshot completed successfully. Nov 06 19:44:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6e1389b4-c4cb-4e99-9c03-99e44dc42b3e tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-050584db-dbd3-4bfa-8f6b-74fc95666e44-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:43 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_utoe98zf Nov 06 19:44:43 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-e40b72bd-a2e5-45de-a61c-b3fc8c78216b-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:44 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_utoe98zf" returned: 1 in 0.438s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_utoe98zf' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b81e28-3610-4e90-9cc8-9691dc98b8c7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-e40b72bd-a2e5-45de-a61c-b3fc8c78216b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:44 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD Nov 06 19:44:44 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7a7980-8d9d-4d52-b4d5-b6d67989c211]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:44 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b Nov 06 19:44:44 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:44 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] 1ceb92fc-a0e0-406c-96f4-c36f37d42275 was qcow2, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:44 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f Nov 06 19:44:44 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:44 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" returned: 0 in 0.403s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:44 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b Nov 06 19:44:44 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:45 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-quobyte-e40b72bd-a2e5-45de-a61c-b3fc8c78216b" released by "delete_volume" :: held 0.795s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Created reservations ['d68ca109-82d3-413d-9a26-e66599b5d045', '1a1be2b2-377a-41e0-9c17-29dfd585d854', 'd04650df-9dc9-4143-b68f-7dd7c2c94e4e', 'ce2d032f-245f-49ad-8962-7e2d835215f4'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:45 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:45 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:45 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.302s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Deleted volume successfully. Nov 06 19:44:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b2e11a23-7c15-428b-a3d8-b21cc0fec0a6 tempest-VolumesSnapshotListTestJSON-770387530 None] Lock "cinder-e40b72bd-a2e5-45de-a61c-b3fc8c78216b-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:46 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" returned: 0 in 2.288s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:46 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275__o8foxgwdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:44:46 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Converted 112.00 MB image at 48.93 MB/s Nov 06 19:44:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:46 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 1G Nov 06 19:44:46 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:47 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:47 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:47 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 1G" returned: 0 in 0.387s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Downloaded image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 for user 22bcd70cb6254396a4024d88dbcbcda7 is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Marking volume d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Copying metadata from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 to d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Creating volume glance metadata for volume d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f backed by image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a71f3f-6de3-435c-aedd-def42a8ac0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8023039a-ad79-4f21-a46b-f4fb3c3c55c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:47 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Volume volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f (d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f): created successfully Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8023039a-ad79-4f21-a46b-f4fb3c3c55c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Flow 'volume_create_manager' (57c208cc-4cd9-4e70-ba6a-c459deae0d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-60280438-19aa-4372-8cfb-935678240134 tempest-VolumesExtendTest-339060551 None] Created volume successfully. Nov 06 19:44:47 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.337s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:44:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:44:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:48 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6094870a-464b-47d6-b56f-85f81eb8646d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:48 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f Nov 06 19:44:48 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:48 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" returned: 0 in 0.425s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 2G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f 2G" returned: 0 in 0.138s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.605s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-70f10118-830a-44e2-a7cf-25e719e8530a tempest-VolumesExtendTest-339060551 None] Extend volume completed successfully. Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Acquiring lock "cinder-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Lock "cinder-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Acquiring lock "cinder-quobyte-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd6b931-5247-482e-8815-7bd12c8d379e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:50 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f Nov 06 19:44:50 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:50 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" returned: 0 in 0.400s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:50 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f Nov 06 19:44:50 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:50 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" returned: 0 in 0.264s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f" released by "delete_volume" :: held 0.722s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Created reservations ['43ab7feb-3017-49af-b4b0-b756ba046281', 'ca177e97-2d7b-4b2f-95f4-cb8dbccd117d', '9169df46-4323-4c6d-8842-808fde1791aa', '67b20658-0954-4500-b48e-28dcbd856cd5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:50 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:44:50 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:51 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.339s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:44:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Deleted volume successfully. Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-56ca950d-085d-4233-b292-3a86de71ca6d tempest-VolumesExtendTest-339060551 None] Lock "cinder-d7d7abd3-a5ea-4b90-9d04-f73fc5f8f29f-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Flow 'volume_create_manager' (70e2abf5-bc71-4296-aa0f-907c32a4270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2898ba35-c930-4f98-8d12-c46c2d1961e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2898ba35-c930-4f98-8d12-c46c2d1961e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1693634104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17382edb-e024-4cf1-b67b-1977048dc7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca32436061a7463880863562b3e1ffa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:52Z,use_quota=True,user_id='22bcd70cb6254396a4024d88dbcbcda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9465e251-ceb7-415b-a4c8-371cde417d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9465e251-ceb7-415b-a4c8-371cde417d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5835bf6-be0c-4490-8f03-854b0562e2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5835bf6-be0c-4490-8f03-854b0562e2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17382edb-e024-4cf1-b67b-1977048dc7de', 'volume_name': 'volume-17382edb-e024-4cf1-b67b-1977048dc7de', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebb1c2c-ffdb-4c1a-8fa0-ba9d27f5ef19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebb1c2c-ffdb-4c1a-8fa0-ba9d27f5ef19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef096f35-ec0b-45d5-9ee9-da66a3a7b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Volume 17382edb-e024-4cf1-b67b-1977048dc7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17382edb-e024-4cf1-b67b-1977048dc7de', 'volume_size': 1} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1693634104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17382edb-e024-4cf1-b67b-1977048dc7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca32436061a7463880863562b3e1ffa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:52Z,use_quota=True,user_id='22bcd70cb6254396a4024d88dbcbcda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Creating volume 17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:51 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:51 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de 1073741824 Nov 06 19:44:51 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:52 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de 1073741824" returned: 0 in 0.492s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:52 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de Nov 06 19:44:52 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:52 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de" returned: 0 in 0.308s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef096f35-ec0b-45d5-9ee9-da66a3a7b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17382edb-e024-4cf1-b67b-1977048dc7de', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235186be-34d4-4a0d-88c3-189ef991b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Volume volume-17382edb-e024-4cf1-b67b-1977048dc7de (17382edb-e024-4cf1-b67b-1977048dc7de): created successfully Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235186be-34d4-4a0d-88c3-189ef991b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Flow 'volume_create_manager' (70e2abf5-bc71-4296-aa0f-907c32a4270e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b80ae499-d60e-41f4-9457-f7ab9e5ea127 tempest-VolumesExtendTest-339060551 None] Created volume successfully. Nov 06 19:44:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Creating offline snapshot 9a1fd4d2-35fd-4f35-ae87-e962b04979ac of volume 17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:44:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7bbd7-0d6a-4b72-a085-5154c19679ff]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:54 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de Nov 06 19:44:54 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:54 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de" returned: 0 in 0.403s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:54 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac 1G Nov 06 19:44:54 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:55 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac 1G" returned: 0 in 0.578s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17382edb-e024-4cf1-b67b-1977048dc7de -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:55 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17382edb-e024-4cf1-b67b-1977048dc7de -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac Nov 06 19:44:55 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:55 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17382edb-e024-4cf1-b67b-1977048dc7de -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac" returned: 0 in 0.330s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:55 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac is being set with open permissions: ugo+rw Nov 06 19:44:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:55 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac Nov 06 19:44:55 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:55 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac" returned: 0 in 0.282s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:55 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.info Nov 06 19:44:55 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:56 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.info" returned: 0 in 0.303s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:56 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.info is being set with open permissions: ugo+rw Nov 06 19:44:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:56 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.info Nov 06 19:44:56 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:56 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.info" returned: 0 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c600405c-0e42-4e46-9350-b56bfe26f910 tempest-VolumesExtendTest-339060551 None] Create snapshot completed successfully Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[824e9ebe-54f9-44c0-ad10-7feb4f4c0a65]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:57 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de Nov 06 19:44:57 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Flow 'volume_create_manager' (4708c865-066b-46cd-8f32-c0a6c0e1085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cfdd3d-1d84-4488-a0ca-7c81a792e92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cfdd3d-1d84-4488-a0ca-7c81a792e92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-935969333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0493cc2d-7366-4b38-ab28-6bca1ad5183b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c194ca3badd3410db9535121e39183a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:58Z,use_quota=True,user_id='8b31c2c874e44c96994ebee8b62f5835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa3279e-bd96-4652-8c56-1c869281d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa3279e-bd96-4652-8c56-1c869281d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71f37bd-82be-4edf-8a28-d5a5d177f4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71f37bd-82be-4edf-8a28-d5a5d177f4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0493cc2d-7366-4b38-ab28-6bca1ad5183b', 'volume_name': 'volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1e4e25-3be3-4cdf-b20e-613c7a36e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1e4e25-3be3-4cdf-b20e-613c7a36e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762867e6-4b26-4d13-8530-f4a26f42978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:57 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Volume 0493cc2d-7366-4b38-ab28-6bca1ad5183b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b', 'volume_size': 1} Nov 06 19:44:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:58 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de" returned: 0 in 0.448s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac 2G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac 2G" returned: 0 in 0.177s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.674s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-935969333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0493cc2d-7366-4b38-ab28-6bca1ad5183b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c194ca3badd3410db9535121e39183a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:44:58Z,use_quota=True,user_id='8b31c2c874e44c96994ebee8b62f5835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Creating volume 0493cc2d-7366-4b38-ab28-6bca1ad5183b {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:44:58 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:58 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b 1073741824 Nov 06 19:44:58 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c13b7e0f-72e1-48ef-bf94-39151e335cf2 tempest-VolumesExtendTest-339060551 None] Extend volume completed successfully. Nov 06 19:44:58 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b 1073741824" returned: 0 in 0.552s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Acquiring lock "cinder-9a1fd4d2-35fd-4f35-ae87-e962b04979ac-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:58 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b Nov 06 19:44:58 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Lock "cinder-9a1fd4d2-35fd-4f35-ae87-e962b04979ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Acquiring lock "cinder-quobyte-17382edb-e024-4cf1-b67b-1977048dc7de" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-17382edb-e024-4cf1-b67b-1977048dc7de" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Acquiring lock "cinder-quobyte-9a1fd4d2-35fd-4f35-ae87-e962b04979ac" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-9a1fd4d2-35fd-4f35-ae87-e962b04979ac" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:44:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Deleting offline snapshot 9a1fd4d2-35fd-4f35-ae87-e962b04979ac of volume 17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] snapshot_file for this snap is: volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8505d970-e18c-4613-bbc2-bae617e4e551]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:59 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac Nov 06 19:44:59 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:59 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b" returned: 0 in 0.271s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762867e6-4b26-4d13-8530-f4a26f42978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b648e2-416c-4ec1-8744-42dddd154e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:44:59 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Volume volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b (0493cc2d-7366-4b38-ab28-6bca1ad5183b): created successfully Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b648e2-416c-4ec1-8744-42dddd154e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Flow 'volume_create_manager' (4708c865-066b-46cd-8f32-c0a6c0e1085f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:44:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ea185a5d-6583-4406-ba46-c70619a2d8da tempest-VolumesMetadataTest-1979751217 None] Created volume successfully. Nov 06 19:44:59 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac" returned: 0 in 0.408s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17382edb-e024-4cf1-b67b-1977048dc7de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d18c02b-37a5-43c2-9e1e-17c818de0898]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:59 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de Nov 06 19:44:59 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:44:59 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de" returned: 0 in 0.370s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:44:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:44:59 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac Nov 06 19:44:59 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:00 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac" returned: 0 in 0.532s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:00 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac Nov 06 19:45:00 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:00 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de.9a1fd4d2-35fd-4f35-ae87-e962b04979ac" returned: 0 in 0.315s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-9a1fd4d2-35fd-4f35-ae87-e962b04979ac" released by "_delete_snapshot" :: held 1.768s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-17382edb-e024-4cf1-b67b-1977048dc7de" released by "delete_snapshot" :: held 1.800s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Created reservations ['0e17581a-d9c3-4fc5-aa59-824dcd991ee3', '0ad6ab62-7ce7-494d-a80c-fed133d8f2ef', '98fe53cf-519a-4ea1-8204-03c3890fea9c', 'b08e4cae-7e4a-455c-ba3e-f27110ea7517'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Acquiring lock "cinder-0493cc2d-7366-4b38-ab28-6bca1ad5183b-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Lock "cinder-0493cc2d-7366-4b38-ab28-6bca1ad5183b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Acquiring lock "cinder-quobyte-0493cc2d-7366-4b38-ab28-6bca1ad5183b" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Delete snapshot completed successfully. Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Lock "cinder-quobyte-0493cc2d-7366-4b38-ab28-6bca1ad5183b" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2f529df4-7a19-4676-a15c-c61faef7927d tempest-VolumesExtendTest-339060551 None] Lock "cinder-9a1fd4d2-35fd-4f35-ae87-e962b04979ac-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11eb9b-6272-4d37-9ec0-06e5e5205bf0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:01 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b Nov 06 19:45:01 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Acquiring lock "cinder-17382edb-e024-4cf1-b67b-1977048dc7de-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Lock "cinder-17382edb-e024-4cf1-b67b-1977048dc7de-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Acquiring lock "cinder-quobyte-17382edb-e024-4cf1-b67b-1977048dc7de" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-17382edb-e024-4cf1-b67b-1977048dc7de" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[871e715b-07f5-4f6e-ae83-fa34c81aae53]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:01 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b" returned: 0 in 0.440s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:01 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b Nov 06 19:45:01 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:01 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de Nov 06 19:45:01 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:01 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0493cc2d-7366-4b38-ab28-6bca1ad5183b" returned: 0 in 0.267s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Lock "cinder-quobyte-0493cc2d-7366-4b38-ab28-6bca1ad5183b" released by "delete_volume" :: held 0.756s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:01 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de" returned: 0 in 0.400s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:01 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de Nov 06 19:45:01 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Created reservations ['af4fd6bc-6d4a-4cf8-a4d3-1972b81fae42', '450110ef-8627-496d-93f6-52bee3481408', '7459f005-0c19-49d2-aa89-226fd5fe9037', 'f16a1833-a8b4-4581-8e20-3cadddfc031a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:01 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:01 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:02 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-17382edb-e024-4cf1-b67b-1977048dc7de" returned: 0 in 0.318s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Lock "cinder-quobyte-17382edb-e024-4cf1-b67b-1977048dc7de" released by "delete_volume" :: held 0.813s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Created reservations ['def51712-91cc-4eab-bd59-31410910d2bf', '64da31be-0ed2-44bd-9041-4291da30ee5b', 'c79d351e-1f33-4bf7-bc7d-e5514944ccd7', '02dc6b54-506b-49a7-a5be-e823959580a3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:02 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Deleted volume successfully. Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8c9379bc-8029-41d3-8fd8-3bf6643abe64 tempest-VolumesMetadataTest-1979751217 None] Lock "cinder-0493cc2d-7366-4b38-ab28-6bca1ad5183b-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:02 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:02 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:02 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Deleted volume successfully. Nov 06 19:45:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f1e3a2e0-f9b7-47b6-8b2c-44a88cb1da1c tempest-VolumesExtendTest-339060551 None] Lock "cinder-17382edb-e024-4cf1-b67b-1977048dc7de-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (a121c6d1-03be-48b9-9a2f-9c6dfaba1c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a69827-37dc-44ea-ba1c-8e745ca70db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a69827-37dc-44ea-ba1c-8e745ca70db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-304775337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:07Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa7c9f6-a990-463e-8955-0b950ed82d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa7c9f6-a990-463e-8955-0b950ed82d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc14b69a-d0c2-48fa-b4e6-c22a1da52d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc14b69a-d0c2-48fa-b4e6-c22a1da52d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7', 'volume_name': 'volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00c1c69-afe9-4939-98fd-9ac90b4171da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00c1c69-afe9-4939-98fd-9ac90b4171da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7835338e-a45f-41e2-8ad9-c31453a6badc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:07 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Volume 6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7', 'volume_size': 1} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-304775337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:07Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Creating volume 6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:07 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:07 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 1073741824 Nov 06 19:45:07 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:07 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 1073741824" returned: 0 in 0.572s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:08 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 Nov 06 19:45:08 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:08 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7" returned: 0 in 0.354s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7835338e-a45f-41e2-8ad9-c31453a6badc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833626be-51cd-4dcf-9ea9-f1905ff2dbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:08 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Volume volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 (6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7): created successfully Nov 06 19:45:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833626be-51cd-4dcf-9ea9-f1905ff2dbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (a121c6d1-03be-48b9-9a2f-9c6dfaba1c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f7141747-2914-4ee9-8a3f-7e86e877079d tempest-VolumesGetTest-2099264010 None] Created volume successfully. Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (3fb70cc1-0bda-45fd-a5f6-6d9940bda382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b99bbc-95f9-4b66-854c-0260ba78b90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b99bbc-95f9-4b66-854c-0260ba78b90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-478034963',display_name='tempest-VolumesGetTest-Volume-1821778821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc9dd5b-f727-4548-8819-92e77114c5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:10Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74742e9-7d8d-4f4a-ba7f-69746e5dadad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74742e9-7d8d-4f4a-ba7f-69746e5dadad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e895814-c6e2-4b29-9b86-debefd09d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e895814-c6e2-4b29-9b86-debefd09d57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc9dd5b-f727-4548-8819-92e77114c5aa', 'volume_name': 'volume-5bc9dd5b-f727-4548-8819-92e77114c5aa', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0fc1ad-9976-4355-bde7-fbffac0d43ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0fc1ad-9976-4355-bde7-fbffac0d43ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d88b74-4531-4418-b3c6-7b44d063d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:10 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Volume 5bc9dd5b-f727-4548-8819-92e77114c5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc9dd5b-f727-4548-8819-92e77114c5aa', 'volume_size': 1} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-478034963',display_name='tempest-VolumesGetTest-Volume-1821778821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc9dd5b-f727-4548-8819-92e77114c5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:10Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Creating volume 5bc9dd5b-f727-4548-8819-92e77114c5aa {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:10 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:10 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa 1073741824 Nov 06 19:45:10 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:10 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa 1073741824" returned: 0 in 0.588s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:10 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa Nov 06 19:45:10 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:11 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d88b74-4531-4418-b3c6-7b44d063d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc9dd5b-f727-4548-8819-92e77114c5aa', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cbe27a-ad00-4493-b27a-13055aa0bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Volume volume-5bc9dd5b-f727-4548-8819-92e77114c5aa (5bc9dd5b-f727-4548-8819-92e77114c5aa): created successfully Nov 06 19:45:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cbe27a-ad00-4493-b27a-13055aa0bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (3fb70cc1-0bda-45fd-a5f6-6d9940bda382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-bf3c9208-52c9-4e15-b283-5d618b0ee275 tempest-VolumesGetTest-2099264010 None] Created volume successfully. Nov 06 19:45:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-5bc9dd5b-f727-4548-8819-92e77114c5aa-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Lock "cinder-5bc9dd5b-f727-4548-8819-92e77114c5aa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-5bc9dd5b-f727-4548-8819-92e77114c5aa" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-5bc9dd5b-f727-4548-8819-92e77114c5aa" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d120d33b-7ed7-49d0-8227-e3216d344461]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:12 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa Nov 06 19:45:12 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:13 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa" returned: 0 in 0.460s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:13 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa Nov 06 19:45:13 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:13 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5bc9dd5b-f727-4548-8819-92e77114c5aa" returned: 0 in 0.331s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-5bc9dd5b-f727-4548-8819-92e77114c5aa" released by "delete_volume" :: held 0.857s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Created reservations ['91b8b8e6-9a22-4b28-bc4b-f9058204c749', 'ceb288f6-2c83-40d1-8ed0-e38488e60989', '95a03c0c-c866-41ac-83e2-22313a225ce7', '2bc9b922-d9dc-49c6-b556-2b2a848d38e1'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:13 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:13 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Lock "cinder-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a751dc-4ddb-4692-9a98-e5a7254fcf05]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:13 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.434s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Deleted volume successfully. Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ccd82f2f-2e31-4969-92c3-817b1c12504f tempest-VolumesGetTest-2099264010 None] Lock "cinder-5bc9dd5b-f727-4548-8819-92e77114c5aa-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:14 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 Nov 06 19:45:14 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:14 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7" returned: 0 in 0.482s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:14 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7 Nov 06 19:45:14 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:14 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7" returned: 0 in 0.274s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7" released by "delete_volume" :: held 0.841s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Created reservations ['556be77f-f714-450d-8ff9-b087b9794058', '709b7bb7-c49e-4016-97b8-4a9483a199cd', '705ab804-1744-4b43-81b7-a0aca474dfb2', '69405235-693d-483b-b5cd-7177aa7c4de9'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:14 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:14 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:15 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.365s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:15 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Deleted volume successfully. Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c5b23436-14af-4737-817a-1e7a073bdadd tempest-VolumesGetTest-2099264010 None] Lock "cinder-6881a5a8-0565-4ce4-9d9b-ab1141b6d6f7-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (3aa43b88-62c1-41e5-9fde-c6bec92f637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cedf0c-a674-41fa-a5fb-63ee99a4a696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cedf0c-a674-41fa-a5fb-63ee99a4a696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1388791218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71076929-52b4-41a8-b424-dc797ac5cce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:16Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a7092b-88ba-4494-a769-0a3fb677a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a7092b-88ba-4494-a769-0a3fb677a93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb1a5f5-18aa-422c-a3e7-c90163a6b44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb1a5f5-18aa-422c-a3e7-c90163a6b44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71076929-52b4-41a8-b424-dc797ac5cce1', 'volume_name': 'volume-71076929-52b4-41a8-b424-dc797ac5cce1', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf6f0ee-b953-4746-984d-cd65ee8c0280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf6f0ee-b953-4746-984d-cd65ee8c0280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f47e4b-7e10-40e8-8861-994ba0982dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:15 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Volume 71076929-52b4-41a8-b424-dc797ac5cce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71076929-52b4-41a8-b424-dc797ac5cce1', 'volume_size': 1} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1388791218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71076929-52b4-41a8-b424-dc797ac5cce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:16Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Creating volume 71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:15 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:15 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 1073741824 Nov 06 19:45:15 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:16 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 1073741824" returned: 0 in 0.560s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:16 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 Nov 06 19:45:16 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:16 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1" returned: 0 in 0.297s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f47e4b-7e10-40e8-8861-994ba0982dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71076929-52b4-41a8-b424-dc797ac5cce1', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c4c907-927c-4511-a1e2-6e9fdbc83f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:16 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Volume volume-71076929-52b4-41a8-b424-dc797ac5cce1 (71076929-52b4-41a8-b424-dc797ac5cce1): created successfully Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c4c907-927c-4511-a1e2-6e9fdbc83f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (3aa43b88-62c1-41e5-9fde-c6bec92f637e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:16 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8b492d2b-85c4-440f-b3d0-569e0fddbc24 tempest-VolumesGetTest-2099264010 None] Created volume successfully. Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (63bdb591-1a27-44a3-b81d-0f1e91cdced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375fe693-6b2d-4c98-8cda-e32723e1d938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375fe693-6b2d-4c98-8cda-e32723e1d938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1744772974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0915d8-31d0-4dae-89ef-24f5ccd95fb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=71076929-52b4-41a8-b424-dc797ac5cce1,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:18Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b45092b-a7df-4b59-bce5-a50f77cad402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b45092b-a7df-4b59-bce5-a50f77cad402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8fac1b-28e9-48d7-b466-5ad273b87241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8fac1b-28e9-48d7-b466-5ad273b87241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae0915d8-31d0-4dae-89ef-24f5ccd95fb4', 'volume_name': 'volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4', 'volume_size': 1, 'source_volid': '71076929-52b4-41a8-b424-dc797ac5cce1', 'source_volstatus': 'available'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a698c45-b677-4325-bc68-0bbce68a35a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a698c45-b677-4325-bc68-0bbce68a35a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8fe81f-fd90-4861-afdf-c0c0643f8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Volume ae0915d8-31d0-4dae-89ef-24f5ccd95fb4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4', 'volume_size': 1, 'source_volid': '71076929-52b4-41a8-b424-dc797ac5cce1', 'source_volstatus': 'available'} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:18 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Cloning volume 71076929-52b4-41a8-b424-dc797ac5cce1 to volume ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Creating offline snapshot 070a1be7-da61-4122-84ed-256a227da4c8 of volume 71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[231147c6-aff7-424a-8955-40ea09d6cd42]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:18 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 Nov 06 19:45:18 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:18 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1" returned: 0 in 0.471s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:18 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 1G Nov 06 19:45:18 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:19 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 1G" returned: 0 in 0.626s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71076929-52b4-41a8-b424-dc797ac5cce1 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:19 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71076929-52b4-41a8-b424-dc797ac5cce1 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 Nov 06 19:45:19 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:19 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71076929-52b4-41a8-b424-dc797ac5cce1 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8" returned: 0 in 0.328s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:19 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 is being set with open permissions: ugo+rw Nov 06 19:45:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:19 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 Nov 06 19:45:19 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:20 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8" returned: 0 in 0.327s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:20 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.info Nov 06 19:45:20 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (b0637404-4acd-4e01-951d-9eb041f4ec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee7f5c2-2207-4c67-9302-9749f3654429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee7f5c2-2207-4c67-9302-9749f3654429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-966306357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8c7d7f-0afd-4716-8e4d-895f1680b901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:20Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65fe3c4-4cc6-494f-9411-e57919952c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65fe3c4-4cc6-494f-9411-e57919952c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2363b9-7a4f-49b1-b712-efd6188e1c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2363b9-7a4f-49b1-b712-efd6188e1c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8c7d7f-0afd-4716-8e4d-895f1680b901', 'volume_name': 'volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8570e42-84ab-4bc5-a698-5dd8d98f43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8570e42-84ab-4bc5-a698-5dd8d98f43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b70efe-d0bf-40fc-8644-bf144e985587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:20 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Volume ea8c7d7f-0afd-4716-8e4d-895f1680b901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901', 'volume_size': 1} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:20 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.info" returned: 0 in 0.302s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:20 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.info is being set with open permissions: ugo+rw Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:20 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.info Nov 06 19:45:20 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:20 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.info" returned: 0 in 0.250s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] snapshot: 070a1be7-da61-4122-84ed-256a227da4c8, volume: ae0915d8-31d0-4dae-89ef-24f5ccd95fb4, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf0938-2451-45c9-a82f-9760dbe93470]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:21 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 Nov 06 19:45:21 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:21 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8" returned: 0 in 0.462s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71076929-52b4-41a8-b424-dc797ac5cce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c49c96-4d14-4d93-b9d5-ec0b91410892]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:21 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 Nov 06 19:45:21 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:21 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1" returned: 0 in 0.403s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:45:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:21 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 Nov 06 19:45:21 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=87,cinder:UPDATE=117,cinder:INSERT=33,cinder:DELETE=5 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=114,cinder:SELECT=104,cinder:INSERT=37,cinder:DELETE=12 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:45:30 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" returned: 0 in 8.790s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:45:30 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Converted 1024.00 MB image at 116.49 MB/s Nov 06 19:45:30 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 is being set with open permissions: ugo+rw Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:30 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 Nov 06 19:45:30 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:30 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" returned: 0 in 0.246s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" released by "_copy_volume_from_snapshot" :: held 10.013s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-070a1be7-da61-4122-84ed-256a227da4c8" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-070a1be7-da61-4122-84ed-256a227da4c8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Deleting offline snapshot 070a1be7-da61-4122-84ed-256a227da4c8 of volume 71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:45:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] snapshot_file for this snap is: volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:45:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e945e0c-0386-4ab7-80ef-7eac1949a3bf]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:31 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 Nov 06 19:45:31 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:31 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8" returned: 0 in 0.400s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71076929-52b4-41a8-b424-dc797ac5cce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:45:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ef655c-e836-4f9b-8928-323d4528f298]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:31 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 Nov 06 19:45:31 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:32 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1" returned: 0 in 0.576s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:32 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 Nov 06 19:45:32 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:32 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8" returned: 0 in 0.353s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:32 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8 Nov 06 19:45:32 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:32 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1.070a1be7-da61-4122-84ed-256a227da4c8" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-070a1be7-da61-4122-84ed-256a227da4c8" released by "_delete_snapshot" :: held 1.738s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.305s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.229s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-966306357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8c7d7f-0afd-4716-8e4d-895f1680b901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:20Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Creating volume ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:32 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8fe81f-fd90-4861-afdf-c0c0643f8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4', 'volume_size': 1, 'source_volid': '71076929-52b4-41a8-b424-dc797ac5cce1', 'source_volstatus': 'available'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:32 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 1073741824 Nov 06 19:45:32 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562f237f-6363-4b98-863a-8af719037f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Volume volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 (ae0915d8-31d0-4dae-89ef-24f5ccd95fb4): created successfully Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562f237f-6363-4b98-863a-8af719037f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (63bdb591-1a27-44a3-b81d-0f1e91cdced9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-02c1e708-467b-403b-844c-5068908e6578 tempest-VolumesGetTest-2099264010 None] Created volume successfully. Nov 06 19:45:33 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 1073741824" returned: 0 in 0.436s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:33 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 Nov 06 19:45:33 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:33 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b70efe-d0bf-40fc-8644-bf144e985587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ca50d6-579c-46e0-87e0-f087ebeb9d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Volume volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 (ea8c7d7f-0afd-4716-8e4d-895f1680b901): created successfully Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ca50d6-579c-46e0-87e0-f087ebeb9d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (b0637404-4acd-4e01-951d-9eb041f4ec46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-bc613126-5ca5-45d2-a092-cb67d7a2439c tempest-VolumesSnapshotTestJSON-220666478 None] Created volume successfully. Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (e944c7d1-751c-4690-8a0b-ae692962ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cf98e7-ce89-4b30-a43f-cd4b6abe1d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cf98e7-ce89-4b30-a43f-cd4b6abe1d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-753682161',display_name='tempest-VolumesGetTest-Volume-996823698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c6499a-0d15-4cc3-90b7-51d04439dab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:35Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb82140-4df4-46e2-b81e-f7cb54eb83c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb82140-4df4-46e2-b81e-f7cb54eb83c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02e5c23-f0be-477f-b5fb-cd3ece3cfd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02e5c23-f0be-477f-b5fb-cd3ece3cfd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c6499a-0d15-4cc3-90b7-51d04439dab9', 'volume_name': 'volume-21c6499a-0d15-4cc3-90b7-51d04439dab9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec2fb68-cfbd-4f82-9337-937ce0fa0dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec2fb68-cfbd-4f82-9337-937ce0fa0dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35fb87f-d363-4c54-b718-6021518a7985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Volume 21c6499a-0d15-4cc3-90b7-51d04439dab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c6499a-0d15-4cc3-90b7-51d04439dab9', 'volume_size': 1} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-753682161',display_name='tempest-VolumesGetTest-Volume-996823698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c6499a-0d15-4cc3-90b7-51d04439dab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:35Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Creating volume 21c6499a-0d15-4cc3-90b7-51d04439dab9 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:34 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:34 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 1073741824 Nov 06 19:45:34 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:35 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 1073741824" returned: 0 in 0.523s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:35 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 Nov 06 19:45:35 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:35 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9" returned: 0 in 0.255s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35fb87f-d363-4c54-b718-6021518a7985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c6499a-0d15-4cc3-90b7-51d04439dab9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60a4bb8-8e86-480b-92bc-e61696eb556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Creating offline snapshot 88066d5d-de5c-4be4-8687-0aa093c23d41 of volume ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:45:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Volume volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 (21c6499a-0d15-4cc3-90b7-51d04439dab9): created successfully Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60a4bb8-8e86-480b-92bc-e61696eb556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (e944c7d1-751c-4690-8a0b-ae692962ed62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a98be78-482b-4889-9e90-733113fb50d5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7d243b1b-b043-4940-a980-83521e280993 tempest-VolumesGetTest-2099264010 None] Created volume successfully. Nov 06 19:45:35 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 Nov 06 19:45:35 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:35 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901" returned: 0 in 0.379s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:35 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 1G Nov 06 19:45:35 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:36 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 1G" returned: 0 in 0.404s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:36 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 Nov 06 19:45:36 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:36 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:36 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 is being set with open permissions: ugo+rw Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:36 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 Nov 06 19:45:36 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-21c6499a-0d15-4cc3-90b7-51d04439dab9-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Lock "cinder-21c6499a-0d15-4cc3-90b7-51d04439dab9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-21c6499a-0d15-4cc3-90b7-51d04439dab9" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-21c6499a-0d15-4cc3-90b7-51d04439dab9" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b3a26a-dd92-4e96-8c9d-5e12005d7c88]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:36 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41" returned: 0 in 0.329s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:37 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.info Nov 06 19:45:37 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:37 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 Nov 06 19:45:37 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:37 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.info" returned: 0 in 0.274s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:37 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.info is being set with open permissions: ugo+rw Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:37 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.info Nov 06 19:45:37 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:37 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9" returned: 0 in 0.417s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:37 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9 Nov 06 19:45:37 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:37 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.info" returned: 0 in 0.289s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:37 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-21c6499a-0d15-4cc3-90b7-51d04439dab9" returned: 0 in 0.263s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-21c6499a-0d15-4cc3-90b7-51d04439dab9" released by "delete_volume" :: held 0.730s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3e7e10de-6997-4a26-bb92-308b643bda8c tempest-VolumesSnapshotTestJSON-220666478 None] Create snapshot completed successfully Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Created reservations ['b0a00568-c77a-4916-8a14-66a400e6b290', 'a09b24d1-5ac9-477e-8b4a-125254ed3155', '77944052-5be8-4ce6-bf95-a56201ed7ff7', 'c68ec5de-b5a9-42b3-a74b-ba1c3a15fb47'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:37 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:37 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:38 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.282s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Deleted volume successfully. Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Lock "cinder-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8afe9683-d47f-40d3-a754-c80728826809 tempest-VolumesGetTest-2099264010 None] Lock "cinder-21c6499a-0d15-4cc3-90b7-51d04439dab9-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13547d6-6ab6-48b8-ba4a-9db1ce6012d0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:38 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 Nov 06 19:45:38 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-88066d5d-de5c-4be4-8687-0aa093c23d41-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-88066d5d-de5c-4be4-8687-0aa093c23d41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-ea8c7d7f-0afd-4716-8e4d-895f1680b901" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-ea8c7d7f-0afd-4716-8e4d-895f1680b901" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-88066d5d-de5c-4be4-8687-0aa093c23d41" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-88066d5d-de5c-4be4-8687-0aa093c23d41" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Deleting offline snapshot 88066d5d-de5c-4be4-8687-0aa093c23d41 of volume ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] snapshot_file for this snap is: volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[14244483-d7f9-4eeb-8e07-e870f5107e62]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:38 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" returned: 0 in 0.412s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:38 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4 Nov 06 19:45:38 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:38 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 Nov 06 19:45:38 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:38 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" returned: 0 in 0.277s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:38 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41" returned: 0 in 0.394s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4" released by "delete_volume" :: held 0.766s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[238521f3-28bd-45a8-b30d-b029a8773bb7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:38 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Created reservations ['588b6285-80e8-41f6-9b30-7f1b42f66028', '07de7fda-5657-4fe1-ab6e-8f641ab6c1cd', 'e3db71aa-4cb8-463f-a24a-41d33a1c840c', 'bdd288cd-4fa3-46a7-aa22-1b281827ca72'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:39 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 Nov 06 19:45:39 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:39 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:39 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-71076929-52b4-41a8-b424-dc797ac5cce1-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Lock "cinder-71076929-52b4-41a8-b424-dc797ac5cce1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:39 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901" returned: 0 in 0.487s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-71076929-52b4-41a8-b424-dc797ac5cce1" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:39 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.376s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-71076929-52b4-41a8-b424-dc797ac5cce1" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:39 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 Nov 06 19:45:39 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Deleted volume successfully. Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f582771-ce96-42e9-b48f-c75d42e1d825]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4b588d5e-91c8-4c2d-975b-7ae1f8124e7f tempest-VolumesGetTest-2099264010 None] Lock "cinder-ae0915d8-31d0-4dae-89ef-24f5ccd95fb4-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:39 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 Nov 06 19:45:39 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:39 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41" returned: 0 in 0.386s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:39 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41 Nov 06 19:45:39 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:39 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1" returned: 0 in 0.408s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:39 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1 Nov 06 19:45:39 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:40 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901.88066d5d-de5c-4be4-8687-0aa093c23d41" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-88066d5d-de5c-4be4-8687-0aa093c23d41" released by "_delete_snapshot" :: held 1.625s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-ea8c7d7f-0afd-4716-8e4d-895f1680b901" released by "delete_snapshot" :: held 1.650s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['79c1432b-a174-4737-aa70-91c97aea2efe', '7a982cf9-2ce4-4557-8824-5d15eacca9e4', '20f758bd-b2f6-41bd-b56c-8d176d9e99f2', 'c99702ad-afc0-4399-96bb-f167ebc02703'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Delete snapshot completed successfully. Nov 06 19:45:40 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5a38500f-46db-406c-b7cb-11b0840b77ea tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-88066d5d-de5c-4be4-8687-0aa093c23d41-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-71076929-52b4-41a8-b424-dc797ac5cce1" returned: 0 in 0.275s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-71076929-52b4-41a8-b424-dc797ac5cce1" released by "delete_volume" :: held 0.774s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Created reservations ['a88a031d-a9fc-4757-9a2d-c2665482fe9e', 'a40c668d-7749-4fb7-8f6c-b76660fc4997', '0e2487c9-8830-4e4c-a367-35ff31dbd4df', '5e899807-c94a-4fed-b391-4d4de1c788f8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:40 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:40 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:40 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.264s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Deleted volume successfully. Nov 06 19:45:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-251b936c-c4ed-48a5-a22d-db595c488fd1 tempest-VolumesGetTest-2099264010 None] Lock "cinder-71076929-52b4-41a8-b424-dc797ac5cce1-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (c691cfd6-bde8-49d0-b026-bd7b2523e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389d92c4-6a83-4b32-abc8-0c71b46991a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389d92c4-6a83-4b32-abc8-0c71b46991a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1721462185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72ae27b-cdc4-4e57-8d78-503b8ae34f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:41Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c29615-31e5-4d64-8aa2-e3b1a3232adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c29615-31e5-4d64-8aa2-e3b1a3232adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38365d0b-e8b1-406a-bedd-a90b6e2d6e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38365d0b-e8b1-406a-bedd-a90b6e2d6e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72ae27b-cdc4-4e57-8d78-503b8ae34f12', 'volume_name': 'volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0212a7e-8eb1-40d6-955e-ec366ba26600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0212a7e-8eb1-40d6-955e-ec366ba26600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d144be7-25ea-46cb-abc7-304ee5a4681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Volume c72ae27b-cdc4-4e57-8d78-503b8ae34f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12', 'volume_size': 1} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1721462185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72ae27b-cdc4-4e57-8d78-503b8ae34f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:41Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Creating volume c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:41 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:41 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 1073741824 Nov 06 19:45:41 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (0b479dfc-89ce-4dd6-b612-77cc3f090307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecb1529-511a-4215-a919-7491bbc56584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecb1529-511a-4215-a919-7491bbc56584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1169913222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe9c547-730d-4fb6-abe0-389320216d6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:41Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae826c9-a2b4-4890-a5ca-aee5635315c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae826c9-a2b4-4890-a5ca-aee5635315c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e071701-b975-4ccd-8e88-efa89c7cf2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e071701-b975-4ccd-8e88-efa89c7cf2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfe9c547-730d-4fb6-abe0-389320216d6c', 'volume_name': 'volume-cfe9c547-730d-4fb6-abe0-389320216d6c', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257e6f8f-5b80-405e-880a-d2667afb2b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257e6f8f-5b80-405e-880a-d2667afb2b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9854f44-b514-451b-91d8-5340de0a1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:41 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Volume cfe9c547-730d-4fb6-abe0-389320216d6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfe9c547-730d-4fb6-abe0-389320216d6c', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Trying to clone cfe9c547-730d-4fb6-abe0-389320216d6c from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:45:41 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 1073741824" returned: 0 in 0.465s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:41 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 Nov 06 19:45:41 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:45:42 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Image download 20.69 MB at 20.69 MB/s Nov 06 19:45:42 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" returned: 0 in 0.302s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d144be7-25ea-46cb-abc7-304ee5a4681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f4500b-4861-4a2f-ad02-5ee3b1e5f046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00019e20-481a-40f5-a6f8-3c5595cda952]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:42 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Volume volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 (c72ae27b-cdc4-4e57-8d78-503b8ae34f12): created successfully Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f4500b-4861-4a2f-ad02-5ee3b1e5f046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (c691cfd6-bde8-49d0-b026-bd7b2523e71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:42 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0ac363a0-b4e3-47ca-b870-0d8662ef5fc5 tempest-VolumesSnapshotTestJSON-220666478 None] Created volume successfully. Nov 06 19:45:42 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD Nov 06 19:45:42 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:42 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 is fetched for user 7e098984840a44b3915c94679b66a544. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e748e41e-f666-4aa2-9d97-35ef699f3b6c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:42 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD Nov 06 19:45:42 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:42 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1169913222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe9c547-730d-4fb6-abe0-389320216d6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:41Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Creating volume cfe9c547-730d-4fb6-abe0-389320216d6c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:42 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:42 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c 1073741824 Nov 06 19:45:42 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:43 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c 1073741824" returned: 0 in 0.460s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:43 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c Nov 06 19:45:43 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:43 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c" returned: 0 in 0.252s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.224s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Creating offline snapshot 6876c82d-5872-47b8-8b50-0f422dea8072 of volume c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Attempting download of 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume cfe9c547-730d-4fb6-abe0-389320216d6c. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe3e153-c8db-42f9-8e49-491b1e7480ba]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfbd9dd-28d3-48c0-9311-5c06fad66e53]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_m6qmo5ng {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:43 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 Nov 06 19:45:43 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:43 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_m6qmo5ng Nov 06 19:45:43 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:44 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:44 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_m6qmo5ng" returned: 0 in 0.336s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_m6qmo5ng {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" returned: 0 in 0.390s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:44 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 1G Nov 06 19:45:44 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:44 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_m6qmo5ng Nov 06 19:45:44 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:44 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_m6qmo5ng" returned: 1 in 0.335s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_m6qmo5ng' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da0b865-2a8d-487c-b6a5-99a9c2f850e8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:44 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 1G" returned: 0 in 0.401s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:44 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 Nov 06 19:45:44 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:44 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD Nov 06 19:45:44 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:44 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] 1ceb92fc-a0e0-406c-96f4-c36f37d42275 was qcow2, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:44 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c Nov 06 19:45:44 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:44 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072" returned: 0 in 0.296s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:44 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 is being set with open permissions: ugo+rw Nov 06 19:45:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:44 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 Nov 06 19:45:44 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:45 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:45 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.info Nov 06 19:45:45 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:45 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.info" returned: 0 in 0.297s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:45 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.info is being set with open permissions: ugo+rw Nov 06 19:45:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:45 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.info Nov 06 19:45:45 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:45 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.info" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-caa729bc-f4c2-4e81-8391-b33dcf307a0b tempest-VolumesSnapshotTestJSON-220666478 None] Create snapshot completed successfully Nov 06 19:45:46 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c" returned: 0 in 2.067s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:46 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_3ayssrj_devstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:45:46 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Converted 112.00 MB image at 54.12 MB/s Nov 06 19:45:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:46 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c 1G Nov 06 19:45:46 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:47 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:47 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:47 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c 1G" returned: 0 in 0.384s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Downloaded image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume cfe9c547-730d-4fb6-abe0-389320216d6c successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 for user 7e098984840a44b3915c94679b66a544 is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Marking volume cfe9c547-730d-4fb6-abe0-389320216d6c as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (264de8f9-0354-4dda-8bbd-ed7642ebe1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba158905-9d30-42d6-817e-3db0da83c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Copying metadata from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 to cfe9c547-730d-4fb6-abe0-389320216d6c. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Creating volume glance metadata for volume cfe9c547-730d-4fb6-abe0-389320216d6c backed by image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba158905-9d30-42d6-817e-3db0da83c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1298180322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0197d18d-8987-43ae-8c10-ae3e7dba90b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6876c82d-5872-47b8-8b50-0f422dea8072,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:47Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516a53ad-cedc-4c9a-a3ed-9a05af80b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516a53ad-cedc-4c9a-a3ed-9a05af80b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd76ffbd-43be-488e-8ea1-27932cd74a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd76ffbd-43be-488e-8ea1-27932cd74a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0197d18d-8987-43ae-8c10-ae3e7dba90b7', 'volume_name': 'volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7', 'volume_size': 2, 'snapshot_id': '6876c82d-5872-47b8-8b50-0f422dea8072'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a6bde9-5249-4005-af42-542fcda40146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a6bde9-5249-4005-af42-542fcda40146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84305f1-63d7-4df0-8aef-66ec2110bff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:47 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Volume 0197d18d-8987-43ae-8c10-ae3e7dba90b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7', 'volume_size': 2, 'snapshot_id': '6876c82d-5872-47b8-8b50-0f422dea8072'} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-6876c82d-5872-47b8-8b50-0f422dea8072-0197d18d-8987-43ae-8c10-ae3e7dba90b7" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-6876c82d-5872-47b8-8b50-0f422dea8072-0197d18d-8987-43ae-8c10-ae3e7dba90b7" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Creating volume 0197d18d-8987-43ae-8c10-ae3e7dba90b7 from snapshot 6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-0197d18d-8987-43ae-8c10-ae3e7dba90b7" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-0197d18d-8987-43ae-8c10-ae3e7dba90b7" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] snapshot: 6876c82d-5872-47b8-8b50-0f422dea8072, volume: 0197d18d-8987-43ae-8c10-ae3e7dba90b7, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:45:47 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b8f2fc-7185-4666-b367-43acbba73efd]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9854f44-b514-451b-91d8-5340de0a1db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe9c547-730d-4fb6-abe0-389320216d6c', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4125bc8a-3018-485b-aadd-a1d461b1bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:47 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Volume volume-cfe9c547-730d-4fb6-abe0-389320216d6c (cfe9c547-730d-4fb6-abe0-389320216d6c): created successfully Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4125bc8a-3018-485b-aadd-a1d461b1bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (0b479dfc-89ce-4dd6-b612-77cc3f090307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d4fc544b-12e8-4b8a-809e-f7c3ef5b5945 tempest-VolumesGetTest-2099264010 None] Created volume successfully. Nov 06 19:45:47 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 Nov 06 19:45:47 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:47 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072" returned: 0 in 0.399s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4132ce28-9db1-4094-bb31-f5e21744fec1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:47 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 Nov 06 19:45:47 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:48 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" returned: 0 in 0.354s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:45:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:45:48 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:45:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:48 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 Nov 06 19:45:48 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:49 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (d54f5ebc-fba0-4075-a527-caae88b1f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf751169-5310-47e8-8ed5-6712d9505944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf751169-5310-47e8-8ed5-6712d9505944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-509909329',display_name='tempest-VolumesGetTest-Volume-644258188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a546e9-6626-4fb0-a0e7-ea80f5230c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:50Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bb61df-2b78-40f7-8da0-c4186a9f7f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bb61df-2b78-40f7-8da0-c4186a9f7f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a37459-9831-4c4c-a06a-7e5882aacc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a37459-9831-4c4c-a06a-7e5882aacc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a546e9-6626-4fb0-a0e7-ea80f5230c8f', 'volume_name': 'volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8682bce4-b985-43c5-b3aa-5f05d2c75204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8682bce4-b985-43c5-b3aa-5f05d2c75204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d9ffa9-d068-4a3d-b64d-f10c0f6868a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Volume b9a546e9-6626-4fb0-a0e7-ea80f5230c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f', 'volume_size': 1} Nov 06 19:45:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Flow 'volume_create_manager' (2354a9db-9a2e-4d91-862c-a72031e871bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eae10b7-d385-43ca-8ee3-2de4f738d515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eae10b7-d385-43ca-8ee3-2de4f738d515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1479190129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0630ad797ed426c835b5538c2fd34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:52Z,use_quota=True,user_id='6f82a997bdbc46b489ee616e40bd6237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdecb79d-707e-4c20-85db-44dbb37d9244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdecb79d-707e-4c20-85db-44dbb37d9244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3f478f-2f17-4f2f-aab1-e993b42e3cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3f478f-2f17-4f2f-aab1-e993b42e3cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e', 'volume_name': 'volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf94e79b-a0b6-475c-a22a-b557143d1da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf94e79b-a0b6-475c-a22a-b557143d1da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4facdb2f-4792-4f5b-8ff6-d37babfd791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Volume b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e', 'volume_size': 1} Nov 06 19:45:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:54 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7" returned: 0 in 6.602s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:54 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:45:54 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Converted 1024.00 MB image at 155.08 MB/s Nov 06 19:45:54 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 is being set with open permissions: ugo+rw Nov 06 19:45:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:54 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 Nov 06 19:45:54 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:55 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7" returned: 0 in 0.235s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-0197d18d-8987-43ae-8c10-ae3e7dba90b7" released by "_copy_volume_from_snapshot" :: held 7.691s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-6876c82d-5872-47b8-8b50-0f422dea8072-0197d18d-8987-43ae-8c10-ae3e7dba90b7" released by "_create_volume_from_snapshot" :: held 7.764s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.787s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.043s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-509909329',display_name='tempest-VolumesGetTest-Volume-644258188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a546e9-6626-4fb0-a0e7-ea80f5230c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e24efec6be54f609a9ac838fe2faed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:50Z,use_quota=True,user_id='7e098984840a44b3915c94679b66a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Creating volume b9a546e9-6626-4fb0-a0e7-ea80f5230c8f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:55 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:55 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f 1073741824 Nov 06 19:45:55 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84305f1-63d7-4df0-8aef-66ec2110bff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7', 'volume_size': 2, 'snapshot_id': '6876c82d-5872-47b8-8b50-0f422dea8072'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d10728-6180-4e7e-b346-cf4225ca29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:55 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Volume volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 (0197d18d-8987-43ae-8c10-ae3e7dba90b7): created successfully Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d10728-6180-4e7e-b346-cf4225ca29dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (264de8f9-0354-4dda-8bbd-ed7642ebe1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9bd4b207-6a43-4e67-8d3f-d192350ce95e tempest-VolumesSnapshotTestJSON-220666478 None] Created volume successfully. Nov 06 19:45:55 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f 1073741824" returned: 0 in 0.420s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:55 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f Nov 06 19:45:55 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:55 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.315s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1479190129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0630ad797ed426c835b5538c2fd34dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:45:52Z,use_quota=True,user_id='6f82a997bdbc46b489ee616e40bd6237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Creating volume b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:45:55 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d9ffa9-d068-4a3d-b64d-f10c0f6868a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:55 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e 1073741824 Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b550dc9-a9c7-41a2-a815-75f256ff091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:55 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:55 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Volume volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f (b9a546e9-6626-4fb0-a0e7-ea80f5230c8f): created successfully Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b550dc9-a9c7-41a2-a815-75f256ff091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Flow 'volume_create_manager' (d54f5ebc-fba0-4075-a527-caae88b1f12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-94647093-8610-44ef-9c86-952d8cc4a108 tempest-VolumesGetTest-2099264010 None] Created volume successfully. Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-0197d18d-8987-43ae-8c10-ae3e7dba90b7-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-0197d18d-8987-43ae-8c10-ae3e7dba90b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-0197d18d-8987-43ae-8c10-ae3e7dba90b7" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-0197d18d-8987-43ae-8c10-ae3e7dba90b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8200dbb-2be3-4759-bd66-a37adf1ca72f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:56 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 Nov 06 19:45:56 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:56 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e 1073741824" returned: 0 in 0.445s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:56 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e Nov 06 19:45:56 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:56 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:56 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7 Nov 06 19:45:56 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Lock "cinder-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:56 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e" returned: 0 in 0.280s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf78c884-5a18-471b-80f8-ff44f4063d8c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4facdb2f-4792-4f5b-8ff6-d37babfd791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dc0c82-8f00-4712-8cd0-28b28143aec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:45:56 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Volume volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e (b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e): created successfully Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dc0c82-8f00-4712-8cd0-28b28143aec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Flow 'volume_create_manager' (2354a9db-9a2e-4d91-862c-a72031e871bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:45:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-749d15fc-e96e-47af-9b4e-b2b0eaa82de5 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Created volume successfully. Nov 06 19:45:56 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f Nov 06 19:45:56 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:56 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0197d18d-8987-43ae-8c10-ae3e7dba90b7" returned: 0 in 0.295s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-0197d18d-8987-43ae-8c10-ae3e7dba90b7" released by "delete_volume" :: held 0.735s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['d506bee6-69c2-4717-afdf-b5691203cc22', '92ec3599-5dd1-4adc-8e66-adad0ace1def', '35fe23f1-a493-48d3-8095-7746286b2fe4', 'fcbfc73a-bec7-4c6e-b61a-5ab275868b99'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:56 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:56 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:56 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f" returned: 0 in 0.383s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:57 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f Nov 06 19:45:57 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:57 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-6876c82d-5872-47b8-8b50-0f422dea8072-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:57 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Deleted volume successfully. Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-6876c82d-5872-47b8-8b50-0f422dea8072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-6876c82d-5872-47b8-8b50-0f422dea8072" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cbb3fb-1fab-48cf-91b8-80135b6ace13 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-0197d18d-8987-43ae-8c10-ae3e7dba90b7-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-6876c82d-5872-47b8-8b50-0f422dea8072" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Deleting offline snapshot 6876c82d-5872-47b8-8b50-0f422dea8072 of volume c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] snapshot_file for this snap is: volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[40942243-f64b-466e-83b5-380124405c9a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:57 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f" released by "delete_volume" :: held 0.725s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Created reservations ['ced69ffd-cee4-4acd-b0a5-cb5130c62822', 'e0687c12-1a25-4b1d-8cc5-d3055bb88538', '7c173380-8a96-4c94-90b0-a077159924bc', '65a16d2c-3369-4312-9ef1-e91d8d2fea77'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:57 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 Nov 06 19:45:57 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:57 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:57 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:57 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072" returned: 0 in 0.411s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:45:57 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.297s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:57 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Deleted volume successfully. Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[801ca833-f04c-443c-b236-fc22fb55157e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-cfe9c547-730d-4fb6-abe0-389320216d6c-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Lock "cinder-cfe9c547-730d-4fb6-abe0-389320216d6c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bdb87c6c-5538-41fe-ba17-d2c6bea02f20 tempest-VolumesGetTest-2099264010 None] Lock "cinder-b9a546e9-6626-4fb0-a0e7-ea80f5230c8f-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Acquiring lock "cinder-quobyte-cfe9c547-730d-4fb6-abe0-389320216d6c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-cfe9c547-730d-4fb6-abe0-389320216d6c" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:45:57 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 Nov 06 19:45:57 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[69efb482-8219-4180-bf13-bd731a1e8479]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:45:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:58 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c Nov 06 19:45:58 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:58 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c" returned: 0 in 0.450s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:58 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" returned: 0 in 0.656s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:58 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c Nov 06 19:45:58 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:58 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 Nov 06 19:45:58 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-d5a29a81-780e-4929-982f-771bce35e9d7 req-cead0cb5-7ef0-490e-b87a-e7ae789c8d23 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-d5a29a81-780e-4929-982f-771bce35e9d7 req-cead0cb5-7ef0-490e-b87a-e7ae789c8d23 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-d5a29a81-780e-4929-982f-771bce35e9d7 req-cead0cb5-7ef0-490e-b87a-e7ae789c8d23 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-d5a29a81-780e-4929-982f-771bce35e9d7 req-cead0cb5-7ef0-490e-b87a-e7ae789c8d23 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82896a39-dcd8-440e-a9fb-7cf87977083b', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:45:58 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cfe9c547-730d-4fb6-abe0-389320216d6c" returned: 0 in 0.270s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Lock "cinder-quobyte-cfe9c547-730d-4fb6-abe0-389320216d6c" released by "delete_volume" :: held 0.780s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-d5a29a81-780e-4929-982f-771bce35e9d7 req-cead0cb5-7ef0-490e-b87a-e7ae789c8d23 tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] attachment_update completed successfully. Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Created reservations ['462f4181-e429-4111-aed0-3d71bf70fa6b', '65ec9c80-9e19-436b-855e-946ce5512323', '23381199-723d-499b-95b7-03eeee94324c', '705b2ea6-7ec2-478c-bb6a-40ded24cbbfa'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:58 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072" returned: 0 in 0.390s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:45:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:45:58 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072 Nov 06 19:45:58 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:58 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:45:58 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:45:59 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12.6876c82d-5872-47b8-8b50-0f422dea8072" returned: 0 in 0.297s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:59 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.323s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-6876c82d-5872-47b8-8b50-0f422dea8072" released by "_delete_snapshot" :: held 1.899s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Deleted volume successfully. Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" released by "delete_snapshot" :: held 1.936s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-afcf6938-83a0-469f-8c72-10ef6336e171 tempest-VolumesGetTest-2099264010 None] Lock "cinder-cfe9c547-730d-4fb6-abe0-389320216d6c-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['704ffe80-7876-40f6-a6e2-a645aaca0eef', 'da03357a-ae2f-4f80-a7a5-a4388d32c3fb', '21ae53a7-8588-4034-9879-f03232cb9a85', 'fab19024-c3ca-43ea-8ea4-094e491fe7af'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:45:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Delete snapshot completed successfully. Nov 06 19:45:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7bc300a1-22f0-47d9-a22d-457c088304b1 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-6876c82d-5872-47b8-8b50-0f422dea8072-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-c72ae27b-cdc4-4e57-8d78-503b8ae34f12-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-c72ae27b-cdc4-4e57-8d78-503b8ae34f12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fede60-399e-4d61-8a1f-8c4ce11debdc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:00 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 Nov 06 19:46:00 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:01 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" returned: 0 in 0.404s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:01 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12 Nov 06 19:46:01 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:01 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" returned: 0 in 0.266s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-c72ae27b-cdc4-4e57-8d78-503b8ae34f12" released by "delete_volume" :: held 0.768s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['df26ff97-a3a8-4346-83d7-cd3cbfb41ce9', '86db5728-2394-4c07-80b4-35054e0e6346', 'eace8e97-6ca4-4d26-9fcb-ce8018a879f5', 'cccfecee-9db2-45ea-a774-d094515569c3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:01 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:01 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:01 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.261s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Deleted volume successfully. Nov 06 19:46:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-851887ea-f03e-4712-8d10-666ebcace576 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-c72ae27b-cdc4-4e57-8d78-503b8ae34f12-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-d861025c-a75b-4c4b-93d5-bdb7c0c864e5 req-b9f14339-f4b6-4044-948f-b04aae035b3f tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Terminate volume connection completed successfully. Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-d861025c-a75b-4c4b-93d5-bdb7c0c864e5 req-b9f14339-f4b6-4044-948f-b04aae035b3f tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Deleting attachment 82896a39-dcd8-440e-a9fb-7cf87977083b. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (5036e342-aad4-4e77-8abf-83405e960bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8707c7fa-c000-46d8-925a-e0dc569f79b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8707c7fa-c000-46d8-925a-e0dc569f79b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1055859304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d82ed8d-4851-47e6-865d-3b02eb5c3708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:02Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4310fb52-af4d-4296-b0d3-6097f8a15799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4310fb52-af4d-4296-b0d3-6097f8a15799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc919a2-8c3a-4bd7-bb0c-2e0ea45ac625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc919a2-8c3a-4bd7-bb0c-2e0ea45ac625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d82ed8d-4851-47e6-865d-3b02eb5c3708', 'volume_name': 'volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb5e632-6d50-4f17-95d0-5e961a90d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb5e632-6d50-4f17-95d0-5e961a90d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec1a43e-6ef5-47f7-b8ff-605fc4912cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:02 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Volume 1d82ed8d-4851-47e6-865d-3b02eb5c3708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708', 'volume_size': 1} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1055859304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d82ed8d-4851-47e6-865d-3b02eb5c3708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:02Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Creating volume 1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:46:02 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:46:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:02 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 1073741824 Nov 06 19:46:02 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:03 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 1073741824" returned: 0 in 0.518s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Flow 'volume_create_manager' (b7d31b9a-a919-47fb-a443-bd3af462030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedaa81f-1441-41a1-91f2-647c02ec267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedaa81f-1441-41a1-91f2-647c02ec267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1283411219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b95312-9d05-473d-9b8a-b876cfaa7678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21526c4bb36421fa51fe6a4a627dbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:03Z,use_quota=True,user_id='ea664e89b3b44c2fb6b1cf9b1edc1646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc25796-8a81-46cf-b369-0dc316d76011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc25796-8a81-46cf-b369-0dc316d76011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe9a0ac-18e6-4d32-97a1-c226191a2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe9a0ac-18e6-4d32-97a1-c226191a2753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b95312-9d05-473d-9b8a-b876cfaa7678', 'volume_name': 'volume-a9b95312-9d05-473d-9b8a-b876cfaa7678', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c3484e-5de0-40db-9d64-c00dd62d4959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c3484e-5de0-40db-9d64-c00dd62d4959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82e84e1-aa32-4513-9a27-8a23cad969ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:03 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Volume a9b95312-9d05-473d-9b8a-b876cfaa7678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b95312-9d05-473d-9b8a-b876cfaa7678', 'volume_size': 1} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:03 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 Nov 06 19:46:03 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Acquiring lock "cinder-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "cinder-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Acquiring lock "cinder-quobyte-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "cinder-quobyte-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880034f-80d6-4d4b-8ce8-799a41e93bb7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:03 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1283411219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b95312-9d05-473d-9b8a-b876cfaa7678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d21526c4bb36421fa51fe6a4a627dbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:03Z,use_quota=True,user_id='ea664e89b3b44c2fb6b1cf9b1edc1646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Creating volume a9b95312-9d05-473d-9b8a-b876cfaa7678 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:46:03 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec1a43e-6ef5-47f7-b8ff-605fc4912cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:03 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 1073741824 Nov 06 19:46:03 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d034c6-710c-4544-810a-dd11400f7f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:03 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e Nov 06 19:46:03 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:03 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Volume volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 (1d82ed8d-4851-47e6-865d-3b02eb5c3708): created successfully Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d034c6-710c-4544-810a-dd11400f7f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (5036e342-aad4-4e77-8abf-83405e960bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8414f325-0722-4343-968e-3353b113379c tempest-VolumesSnapshotTestJSON-220666478 None] Created volume successfully. Nov 06 19:46:03 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:03 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e Nov 06 19:46:03 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:03 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 1073741824" returned: 0 in 0.467s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:03 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 Nov 06 19:46:03 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:04 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "cinder-quobyte-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e" released by "delete_volume" :: held 0.737s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Created reservations ['9e777a77-040a-4599-8374-7df7994af873', '6593eb06-538b-49cc-91fc-1153df9273cd', '9ba513a4-e5c0-4105-bb21-94fdecfce244', '9a0506ed-bb68-4085-a8f0-5071b7cd47ba'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:04 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:04 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82e84e1-aa32-4513-9a27-8a23cad969ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b95312-9d05-473d-9b8a-b876cfaa7678', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:04 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b358824a-cab7-4af5-8dcf-160186ce99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:04 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Volume volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 (a9b95312-9d05-473d-9b8a-b876cfaa7678): created successfully Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b358824a-cab7-4af5-8dcf-160186ce99f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Flow 'volume_create_manager' (b7d31b9a-a919-47fb-a443-bd3af462030e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0111599b-029e-4aa3-8cfd-f5766462c3d3 tempest-VolumesNegativeTest-1514171012 None] Created volume successfully. Nov 06 19:46:04 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.328s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Deleted volume successfully. Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-1c7a9ac3-5b37-47b6-8342-7ab3a32dceca tempest-TestServerVolumeAttachScenarioOldVersion-1425767783 None] Lock "cinder-b6a71a0e-d2ca-4808-b2d4-1531e5c4fe8e-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Creating offline snapshot e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 of volume 1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc173f5-81c2-4cda-86e7-c5689b5e306e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:04 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 Nov 06 19:46:04 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:05 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708" returned: 0 in 0.537s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:05 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 1G Nov 06 19:46:05 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:05 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 1G" returned: 0 in 0.526s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:05 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 Nov 06 19:46:05 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:06 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" returned: 0 in 0.433s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:06 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 is being set with open permissions: ugo+rw Nov 06 19:46:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:06 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 Nov 06 19:46:06 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:06 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:06 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.info Nov 06 19:46:06 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:06 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.info" returned: 0 in 0.304s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:06 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.info is being set with open permissions: ugo+rw Nov 06 19:46:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:06 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.info Nov 06 19:46:06 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:07 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.info" returned: 0 in 0.270s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:07 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b550a5f8-8ecd-46cd-9ef2-40fe6b0f2ecf tempest-VolumesSnapshotTestJSON-220666478 None] Create snapshot completed successfully Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (e6c50e91-4957-45ec-b75d-58ee7d1192d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744b3921-d8b4-473e-88aa-b9e78cf8a061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744b3921-d8b4-473e-88aa-b9e78cf8a061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1908374825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d4c4a5-7697-4c16-ba29-c4c8d2daf92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b094f0c04041a09d23f805ed5fcdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:09Z,use_quota=True,user_id='77a5c13c56314b6e8a3d46baa525f206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78497fe5-808b-4ae7-bbff-c6ce63d35191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78497fe5-808b-4ae7-bbff-c6ce63d35191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b0d545-1f6c-45ca-b049-e89043a1c17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b0d545-1f6c-45ca-b049-e89043a1c17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45d4c4a5-7697-4c16-ba29-c4c8d2daf92b', 'volume_name': 'volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b', 'volume_size': 1, 'snapshot_id': 'e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e092c8-0bf9-44ea-8ba0-12e08a3faa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e092c8-0bf9-44ea-8ba0-12e08a3faa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30dbe8ad-4269-44b5-bf29-d4acd633fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:08 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Volume 45d4c4a5-7697-4c16-ba29-c4c8d2daf92b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b', 'volume_size': 1, 'snapshot_id': 'e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95'} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Creating volume 45d4c4a5-7697-4c16-ba29-c4c8d2daf92b from snapshot e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] snapshot: e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95, volume: 45d4c4a5-7697-4c16-ba29-c4c8d2daf92b, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aee3823-5169-4039-8630-c1837391a4ea]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:09 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 Nov 06 19:46:09 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:09 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" returned: 0 in 0.480s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa9bfe-e580-4f98-bfbf-a9233881eb10]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:09 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 Nov 06 19:46:09 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:09 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:46:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:09 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b Nov 06 19:46:09 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:18 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=109,cinder:SELECT=114,cinder:DELETE=9,cinder:INSERT=34 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:46:18 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=118,cinder:SELECT=94,cinder:INSERT=32,cinder:DELETE=12 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:46:20 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" returned: 0 in 10.460s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708, size 1024.00 MB, duration 10.46 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:46:20 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Converted 1024.00 MB image at 97.89 MB/s Nov 06 19:46:20 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b is being set with open permissions: ugo+rw Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:20 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b Nov 06 19:46:20 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:20 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" released by "_copy_volume_from_snapshot" :: held 11.739s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" released by "_create_volume_from_snapshot" :: held 11.809s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.823s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30dbe8ad-4269-44b5-bf29-d4acd633fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b', 'volume_size': 1, 'snapshot_id': 'e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b2b04f-3d93-4440-b7c3-0c4eac07c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:20 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Volume volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b (45d4c4a5-7697-4c16-ba29-c4c8d2daf92b): created successfully Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b2b04f-3d93-4440-b7c3-0c4eac07c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Flow 'volume_create_manager' (e6c50e91-4957-45ec-b75d-58ee7d1192d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:20 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-60c5fc4c-3d06-4acb-a34b-095a559daea7 tempest-VolumesSnapshotTestJSON-220666478 None] Created volume successfully. Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4d4d1-4708-4df0-88b3-e74a8a5eb519]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:21 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b Nov 06 19:46:21 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:21 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" returned: 0 in 0.388s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:21 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b Nov 06 19:46:21 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:22 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" returned: 0 in 0.281s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b" released by "delete_volume" :: held 0.715s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['cf9ac5f2-8948-42e2-b368-f593d6c6fa6c', 'e7a8bc2a-987a-43ec-9545-e800b9bf6d6f', '95adf224-acf4-432c-9613-2dd7a1430001', '251908a2-0312-4a53-b781-f266a6682b57'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:22 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:22 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:22 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:22 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Deleted volume successfully. Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2cdc7811-c7d5-4cbb-96bb-3a401b9ab62e tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-45d4c4a5-7697-4c16-ba29-c4c8d2daf92b-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-1d82ed8d-4851-47e6-865d-3b02eb5c3708" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-1d82ed8d-4851-47e6-865d-3b02eb5c3708" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Deleting offline snapshot e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 of volume 1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] snapshot_file for this snap is: volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6df839-22a0-4af3-8f1d-7a85777cc6f7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:22 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 Nov 06 19:46:22 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:23 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" returned: 0 in 0.458s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:46:23 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03148c8-9c23-4bb3-9c70-1b99cdb5903b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:23 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 Nov 06 19:46:23 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:23 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708" returned: 0 in 0.611s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:23 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 Nov 06 19:46:23 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:24 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" returned: 0 in 0.492s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:24 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95 Nov 06 19:46:24 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:24 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708.e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95" released by "_delete_snapshot" :: held 1.990s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-1d82ed8d-4851-47e6-865d-3b02eb5c3708" released by "delete_snapshot" :: held 2.012s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:24 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['190e4418-e1f0-4be4-aee1-d0631b2a50a6', '9affd864-efe1-4f65-8b50-d90b70cb8046', 'b1b1eb8e-d65a-44e6-b941-652dc457fbef', 'c82e4ffe-bdc4-4f5a-8218-c62e485a7c2a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:24 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Delete snapshot completed successfully. Nov 06 19:46:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d7052998-a72f-4ea8-b7fd-298c2d326934 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-e0b0f82d-3c0f-4eee-94dc-fbe97e9d3f95-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-1d82ed8d-4851-47e6-865d-3b02eb5c3708-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-1d82ed8d-4851-47e6-865d-3b02eb5c3708-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-1d82ed8d-4851-47e6-865d-3b02eb5c3708" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-1d82ed8d-4851-47e6-865d-3b02eb5c3708" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a16bd4-1d18-4a85-afe8-a4684eaf8e2a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:26 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 Nov 06 19:46:26 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:26 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:26 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708 Nov 06 19:46:26 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:26 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1d82ed8d-4851-47e6-865d-3b02eb5c3708" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-1d82ed8d-4851-47e6-865d-3b02eb5c3708" released by "delete_volume" :: held 0.778s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:26 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['5798ff38-5d28-48c8-b222-e61d7a8f4e21', 'd9c04933-b5d6-4591-a737-35ec012f399d', '9c9f87b1-3f64-4b8f-8812-2926873ff153', '668efeac-cf2f-4bbb-84ca-507ce68ba164'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:27 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:27 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-ea8c7d7f-0afd-4716-8e4d-895f1680b901-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:27 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.375s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-ea8c7d7f-0afd-4716-8e4d-895f1680b901-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:27 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Deleted volume successfully. Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34077344-d39a-448d-8da4-8b14c20f3620 tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-1d82ed8d-4851-47e6-865d-3b02eb5c3708-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "cinder-quobyte-ea8c7d7f-0afd-4716-8e4d-895f1680b901" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-ea8c7d7f-0afd-4716-8e4d-895f1680b901" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26da1eb-bcbd-4f91-ba79-c9a59b17e29e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:27 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 Nov 06 19:46:27 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:27 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901" returned: 0 in 0.413s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:27 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901 Nov 06 19:46:27 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:28 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ea8c7d7f-0afd-4716-8e4d-895f1680b901" returned: 0 in 0.305s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Acquiring lock "cinder-a9b95312-9d05-473d-9b8a-b876cfaa7678-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-quobyte-ea8c7d7f-0afd-4716-8e4d-895f1680b901" released by "delete_volume" :: held 0.809s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Lock "cinder-a9b95312-9d05-473d-9b8a-b876cfaa7678-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Acquiring lock "cinder-quobyte-a9b95312-9d05-473d-9b8a-b876cfaa7678" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Lock "cinder-quobyte-a9b95312-9d05-473d-9b8a-b876cfaa7678" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Created reservations ['8304c7ab-005f-48b4-a9e2-b32766ea0555', '9aa5b41c-4f54-41ac-9b5e-eb35bb48e69e', 'b12a945b-8115-4036-8216-46eef02c0053', 'eaff273d-428b-45fc-a019-263e81b5f126'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce89d7-646d-467e-adf4-cb78ab15a9ef]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:28 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:28 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:28 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 Nov 06 19:46:28 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:28 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.328s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Deleted volume successfully. Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a60196da-aeb7-4bad-9c85-bff57558a50b tempest-VolumesSnapshotTestJSON-220666478 None] Lock "cinder-ea8c7d7f-0afd-4716-8e4d-895f1680b901-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:28 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678" returned: 0 in 0.526s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:28 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678 Nov 06 19:46:28 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:29 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a9b95312-9d05-473d-9b8a-b876cfaa7678" returned: 0 in 0.278s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Lock "cinder-quobyte-a9b95312-9d05-473d-9b8a-b876cfaa7678" released by "delete_volume" :: held 0.859s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Created reservations ['24077767-1967-4f80-803b-90e1e9569ada', '459eb15e-e88f-4270-a535-60e5b27841c4', '7beb5fad-1053-49a5-a371-ea3aee252ced', 'e27dcf53-7e5c-4847-b585-75c865205efe'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:29 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:29 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:29 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.348s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Deleted volume successfully. Nov 06 19:46:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-367f8f7e-3e6e-4a4f-98bf-42ec85fc0e2a tempest-VolumesNegativeTest-1514171012 None] Lock "cinder-a9b95312-9d05-473d-9b8a-b876cfaa7678-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Flow 'volume_create_manager' (41f7c11e-aa8b-4e05-868a-31d3216c4cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b712a79-d40f-4362-af78-86fa3b8f740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b712a79-d40f-4362-af78-86fa3b8f740b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-157462231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070d96da-bc2d-46e7-89ce-41f8d65db4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f778dce3c443cb71e9e4354326881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:42Z,use_quota=True,user_id='886994e06bd4449a8b2569beed1cd5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf48702-236c-415f-814d-6e5445ff68c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf48702-236c-415f-814d-6e5445ff68c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3a140c-9a03-44d6-8332-dbb6a5268a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3a140c-9a03-44d6-8332-dbb6a5268a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070d96da-bc2d-46e7-89ce-41f8d65db4de', 'volume_name': 'volume-070d96da-bc2d-46e7-89ce-41f8d65db4de', 'volume_size': 2}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb1d71f-b411-4668-8c89-fd2cf7155fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb1d71f-b411-4668-8c89-fd2cf7155fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dd0f56-40df-49fb-947c-b077af355e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:42 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Volume 070d96da-bc2d-46e7-89ce-41f8d65db4de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070d96da-bc2d-46e7-89ce-41f8d65db4de', 'volume_size': 2} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-157462231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070d96da-bc2d-46e7-89ce-41f8d65db4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5f778dce3c443cb71e9e4354326881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:42Z,use_quota=True,user_id='886994e06bd4449a8b2569beed1cd5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Creating volume 070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:46:42 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:46:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de 2147483648 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:42 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de 2147483648 Nov 06 19:46:42 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:43 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de 2147483648" returned: 0 in 0.619s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:43 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de Nov 06 19:46:43 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:43 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de" returned: 0 in 0.334s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99dd0f56-40df-49fb-947c-b077af355e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070d96da-bc2d-46e7-89ce-41f8d65db4de', 'volume_size': 2}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2109e26c-6258-4b69-8a76-7f8a294218df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:43 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Volume volume-070d96da-bc2d-46e7-89ce-41f8d65db4de (070d96da-bc2d-46e7-89ce-41f8d65db4de): created successfully Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2109e26c-6258-4b69-8a76-7f8a294218df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Flow 'volume_create_manager' (41f7c11e-aa8b-4e05-868a-31d3216c4cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f3df4305-fa38-4480-9338-e562b1025afb tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Created volume successfully. Nov 06 19:46:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Creating offline snapshot 08454aac-a07c-4308-a0b5-763bf1aa6fe8 of volume 070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:46:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0cf918-1b1f-416a-9ad2-3b53f56a43c5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:44 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de Nov 06 19:46:44 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:45 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de" returned: 0 in 0.429s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 2G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:45 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 2G Nov 06 19:46:45 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:45 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 2G" returned: 0 in 0.464s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-070d96da-bc2d-46e7-89ce-41f8d65db4de -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:45 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-070d96da-bc2d-46e7-89ce-41f8d65db4de -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 Nov 06 19:46:45 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:46 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-070d96da-bc2d-46e7-89ce-41f8d65db4de -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8" returned: 0 in 0.411s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:46 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 is being set with open permissions: ugo+rw Nov 06 19:46:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:46 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 Nov 06 19:46:46 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:46 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:46 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.info Nov 06 19:46:46 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:46 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.info" returned: 0 in 0.313s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:46 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.info is being set with open permissions: ugo+rw Nov 06 19:46:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:46 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.info Nov 06 19:46:46 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:47 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.info" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-34b319d8-ddac-4041-9c74-0604a46c7db8 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Create snapshot completed successfully Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:47 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:47 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:47 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.346s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "cinder-08454aac-a07c-4308-a0b5-763bf1aa6fe8-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-08454aac-a07c-4308-a0b5-763bf1aa6fe8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "cinder-quobyte-070d96da-bc2d-46e7-89ce-41f8d65db4de" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-quobyte-070d96da-bc2d-46e7-89ce-41f8d65db4de" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "cinder-quobyte-08454aac-a07c-4308-a0b5-763bf1aa6fe8" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-quobyte-08454aac-a07c-4308-a0b5-763bf1aa6fe8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Deleting offline snapshot 08454aac-a07c-4308-a0b5-763bf1aa6fe8 of volume 070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] snapshot_file for this snap is: volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[60abb248-1cc4-46de-91ce-c85cab612809]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:48 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 Nov 06 19:46:48 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:48 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8" returned: 0 in 0.435s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-070d96da-bc2d-46e7-89ce-41f8d65db4de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8b810-8dc2-48e0-a934-5bb10d6fd4d0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:48 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de Nov 06 19:46:48 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:49 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de" returned: 0 in 0.443s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:49 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 Nov 06 19:46:49 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:49 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:49 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8 Nov 06 19:46:49 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:49 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de.08454aac-a07c-4308-a0b5-763bf1aa6fe8" returned: 0 in 0.284s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-quobyte-08454aac-a07c-4308-a0b5-763bf1aa6fe8" released by "_delete_snapshot" :: held 1.748s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-quobyte-070d96da-bc2d-46e7-89ce-41f8d65db4de" released by "delete_snapshot" :: held 1.782s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Created reservations ['7791fdb4-36e3-4bcd-89b7-a4994f78d2f8', 'd15668a9-2e23-47f0-946f-4579ecd08d62', 'd5106a71-639e-4e50-a9d6-822b4b6f695f', 'c7e0b06b-0ab3-4d91-89ea-8ddd80ce220a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Delete snapshot completed successfully. Nov 06 19:46:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-842210d4-23f6-40c2-b01d-f3f4b385cf07 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-08454aac-a07c-4308-a0b5-763bf1aa6fe8-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "cinder-070d96da-bc2d-46e7-89ce-41f8d65db4de-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-070d96da-bc2d-46e7-89ce-41f8d65db4de-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "cinder-quobyte-070d96da-bc2d-46e7-89ce-41f8d65db4de" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-quobyte-070d96da-bc2d-46e7-89ce-41f8d65db4de" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8b9847-9a16-4817-ac95-0881f436835b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:50 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de Nov 06 19:46:50 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:50 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de" returned: 0 in 0.405s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:50 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de Nov 06 19:46:50 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:51 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-070d96da-bc2d-46e7-89ce-41f8d65db4de" returned: 0 in 0.257s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-quobyte-070d96da-bc2d-46e7-89ce-41f8d65db4de" released by "delete_volume" :: held 0.746s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Created reservations ['5b7ce13e-edb2-48e9-9454-e66bb52e02cb', '110bafb2-cece-4d75-b587-158d7caeb5ea', '9b931981-e9b1-4cf0-9345-c5078569c707', '4c866281-c66a-4afe-bd5b-d4572db08307'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:51 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:46:51 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:51 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.318s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:46:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Deleted volume successfully. Nov 06 19:46:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2342f718-26ae-4b70-9a31-6ef3f02a1a25 tempest-VolumesSnapshotNegativeTestJSON-1272417655 None] Lock "cinder-070d96da-bc2d-46e7-89ce-41f8d65db4de-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Flow 'volume_create_manager' (26aae260-78f5-4256-9e26-3626f521dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adaab13-9f17-4117-b43a-e51c7ea54fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adaab13-9f17-4117-b43a-e51c7ea54fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-989987512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab76f900-ce54-450a-99aa-4f780dffe629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bbf230230e420fab95d9af5637ac0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:55Z,use_quota=True,user_id='68730ba98b884fc3aa173779164938c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dd3e84-0543-4605-98d4-e45bb94e3242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dd3e84-0543-4605-98d4-e45bb94e3242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cabd942-64c3-4c02-a420-7fa43c763594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cabd942-64c3-4c02-a420-7fa43c763594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab76f900-ce54-450a-99aa-4f780dffe629', 'volume_name': 'volume-ab76f900-ce54-450a-99aa-4f780dffe629', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13add339-9741-4cee-bb91-5bbddfb001b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13add339-9741-4cee-bb91-5bbddfb001b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05db9f6b-420e-4958-b869-db70d5322652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:54 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Volume ab76f900-ce54-450a-99aa-4f780dffe629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab76f900-ce54-450a-99aa-4f780dffe629', 'volume_size': 1} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-989987512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab76f900-ce54-450a-99aa-4f780dffe629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1bbf230230e420fab95d9af5637ac0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:46:55Z,use_quota=True,user_id='68730ba98b884fc3aa173779164938c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Creating volume ab76f900-ce54-450a-99aa-4f780dffe629 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:46:54 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:46:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:54 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 1073741824 Nov 06 19:46:54 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:55 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 1073741824" returned: 0 in 0.528s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:55 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 Nov 06 19:46:55 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:55 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629" returned: 0 in 0.297s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05db9f6b-420e-4958-b869-db70d5322652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab76f900-ce54-450a-99aa-4f780dffe629', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b58fbe-cc02-4e34-bcc2-deec96bc08e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:46:55 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Volume volume-ab76f900-ce54-450a-99aa-4f780dffe629 (ab76f900-ce54-450a-99aa-4f780dffe629): created successfully Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b58fbe-cc02-4e34-bcc2-deec96bc08e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:46:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Flow 'volume_create_manager' (26aae260-78f5-4256-9e26-3626f521dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:46:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fec3d37f-e2ee-44ba-8e1e-612ace0be4cf tempest-TestImageHashVerification-350025989 None] Created volume successfully. Nov 06 19:46:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:46:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:46:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1c2260-2e3a-4962-8cc6-293eeaaedd53]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:57 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 Nov 06 19:46:57 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:58 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629" returned: 0 in 0.406s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:58 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f8e70-4781-49ae-b326-44698f3fd86a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:46:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:58 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 Nov 06 19:46:58 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:46:58 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Nov 06 19:46:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629" returned: 0 in 0.414s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:46:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 /opt/stack/data/cinder/conversion/ab76f900-ce54-450a-99aa-4f780dffe629.temp_image.bef9904d-8f13-417c-b5c6-57403700a76528u2rtgg.img {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:46:58 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 /opt/stack/data/cinder/conversion/ab76f900-ce54-450a-99aa-4f780dffe629.temp_image.bef9904d-8f13-417c-b5c6-57403700a76528u2rtgg.img Nov 06 19:46:58 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:05 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=62,cinder:SELECT=44,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:47:06 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 /opt/stack/data/cinder/conversion/ab76f900-ce54-450a-99aa-4f780dffe629.temp_image.bef9904d-8f13-417c-b5c6-57403700a76528u2rtgg.img" returned: 0 in 8.413s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad47b1-697a-4544-a47c-840df601a364]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:47:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:07 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 Nov 06 19:47:07 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:07 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629" returned: 0 in 0.594s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:07 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/conversion/ab76f900-ce54-450a-99aa-4f780dffe629.temp_image.bef9904d-8f13-417c-b5c6-57403700a76528u2rtgg.img {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:47:07 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Converted 1024.00 MB image at 121.69 MB/s Nov 06 19:47:07 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] bef9904d-8f13-417c-b5c6-57403700a765 was raw, no need to convert to raw {{(pid=86928) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 19:47:17 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=49,cinder:INSERT=14,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:47:17 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Flow 'volume_create_manager' (95f39651-ecd3-4e32-8c13-36d0700802f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf215fd-39c7-454b-be1f-f4cfc127f525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf215fd-39c7-454b-be1f-f4cfc127f525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-981577675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480bd57c-3ca1-4fb3-b316-7a9be752e799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622fcd65df9d42ab8593359bbedf7a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:19Z,use_quota=True,user_id='838133d608dc4d158f0d5d33d1cdce6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67478f0a-3b5d-4ee5-b1c1-847b7a23ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67478f0a-3b5d-4ee5-b1c1-847b7a23ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc40772-00f1-47bc-8723-2c6487bb66ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc40772-00f1-47bc-8723-2c6487bb66ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480bd57c-3ca1-4fb3-b316-7a9be752e799', 'volume_name': 'volume-480bd57c-3ca1-4fb3-b316-7a9be752e799', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741b80b6-f689-48f5-9142-bf18de157d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741b80b6-f689-48f5-9142-bf18de157d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ccd77c-4f7b-4ab1-bab0-ba3757b0564d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Volume 480bd57c-3ca1-4fb3-b316-7a9be752e799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480bd57c-3ca1-4fb3-b316-7a9be752e799', 'volume_size': 1} Nov 06 19:47:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:28 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:47:28 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Flow 'volume_create_manager' (6e252f9e-98a8-4d87-a3eb-53eabcd6e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d41c06-b61c-4b99-98d8-20abc2ea2086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d41c06-b61c-4b99-98d8-20abc2ea2086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1499934168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e95b4d9-d6d0-4ce7-8796-8944809cdf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8511fd81e82642179e464e192175fc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:30Z,use_quota=True,user_id='874fa9f5f865402ba7d00cf24e0afba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184d998c-7c5e-4abc-9dbe-2e14107658d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184d998c-7c5e-4abc-9dbe-2e14107658d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec21cda9-b68c-4f19-b4ec-3f6e9055f531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec21cda9-b68c-4f19-b4ec-3f6e9055f531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e95b4d9-d6d0-4ce7-8796-8944809cdf10', 'volume_name': 'volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2de3a3b-60be-4823-8839-3586b211e881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2de3a3b-60be-4823-8839-3586b211e881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22447d9a-cac8-4dc3-875d-d13e8db549c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Volume 9e95b4d9-d6d0-4ce7-8796-8944809cdf10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10', 'volume_size': 1} Nov 06 19:47:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.698s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Uploaded volume to glance image-id: bef9904d-8f13-417c-b5c6-57403700a765. {{(pid=86928) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.463s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-981577675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480bd57c-3ca1-4fb3-b316-7a9be752e799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622fcd65df9d42ab8593359bbedf7a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:19Z,use_quota=True,user_id='838133d608dc4d158f0d5d33d1cdce6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Creating volume 480bd57c-3ca1-4fb3-b316-7a9be752e799 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:47:35 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:47:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:35 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 1073741824 Nov 06 19:47:35 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-33defb7e-2857-4a94-9e4d-a8de95a67801 tempest-TestImageHashVerification-350025989 None] Copy volume to image completed successfully. Nov 06 19:47:36 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 1073741824" returned: 0 in 1.228s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:36 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 Nov 06 19:47:36 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:37 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799" returned: 0 in 0.471s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.835s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1499934168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e95b4d9-d6d0-4ce7-8796-8944809cdf10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8511fd81e82642179e464e192175fc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:30Z,use_quota=True,user_id='874fa9f5f865402ba7d00cf24e0afba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Creating volume 9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:47:37 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ccd77c-4f7b-4ab1-bab0-ba3757b0564d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480bd57c-3ca1-4fb3-b316-7a9be752e799', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9974f2-2444-44ae-a55c-da6728023649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:37 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 1073741824 Nov 06 19:47:37 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Volume volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 (480bd57c-3ca1-4fb3-b316-7a9be752e799): created successfully Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9974f2-2444-44ae-a55c-da6728023649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Flow 'volume_create_manager' (95f39651-ecd3-4e32-8c13-36d0700802f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Acquiring lock "cinder-ab76f900-ce54-450a-99aa-4f780dffe629-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:47:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a3dd31b1-d35f-468d-ac48-2d4b9a85500e tempest-TestMinimumBasicScenario-353636532 None] Created volume successfully. Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Lock "cinder-ab76f900-ce54-450a-99aa-4f780dffe629-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Acquiring lock "cinder-quobyte-ab76f900-ce54-450a-99aa-4f780dffe629" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Lock "cinder-quobyte-ab76f900-ce54-450a-99aa-4f780dffe629" acquired by "delete_volume" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c60bd8-3382-4dce-811a-efb4cf66a5fa]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:47:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:37 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 Nov 06 19:47:37 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:38 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629" returned: 0 in 0.572s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:38 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 1073741824" returned: 0 in 0.912s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:38 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629 Nov 06 19:47:38 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:38 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 Nov 06 19:47:38 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:38 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ab76f900-ce54-450a-99aa-4f780dffe629" returned: 0 in 0.265s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Lock "cinder-quobyte-ab76f900-ce54-450a-99aa-4f780dffe629" released by "delete_volume" :: held 0.933s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:47:38 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" returned: 0 in 0.264s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Created reservations ['b69ef297-da37-40ec-8cd0-87ea690f08bc', '52284404-2db9-46b6-88f4-eba002c0dd0d', '9c8ea54f-6a11-4647-b498-d068d81a4e1d', 'a4550d46-5885-4488-975a-fe34c1794f9c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22447d9a-cac8-4dc3-875d-d13e8db549c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48392eca-ef06-4b54-8bd8-e7e1165a5dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:38 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Volume volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 (9e95b4d9-d6d0-4ce7-8796-8944809cdf10): created successfully Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48392eca-ef06-4b54-8bd8-e7e1165a5dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Flow 'volume_create_manager' (6e252f9e-98a8-4d87-a3eb-53eabcd6e702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-845947d7-fc4c-4ac6-b20d-bbed8428fd2e tempest-TestStampPattern-1152151569 None] Created volume successfully. Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:38 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:47:38 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:38 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:47:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Deleted volume successfully. Nov 06 19:47:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aae7fae3-c49e-484a-a40a-bc7bfa510162 tempest-TestImageHashVerification-350025989 None] Lock "cinder-ab76f900-ce54-450a-99aa-4f780dffe629-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:47:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-a31f7706-976c-458a-a090-29df3210f2df req-66d1bd57-311f-4541-9158-5f6cd56d12bc tempest-TestMinimumBasicScenario-353636532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-a31f7706-976c-458a-a090-29df3210f2df req-66d1bd57-311f-4541-9158-5f6cd56d12bc tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-a31f7706-976c-458a-a090-29df3210f2df req-66d1bd57-311f-4541-9158-5f6cd56d12bc tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-a31f7706-976c-458a-a090-29df3210f2df req-66d1bd57-311f-4541-9158-5f6cd56d12bc tempest-TestMinimumBasicScenario-353636532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-480bd57c-3ca1-4fb3-b316-7a9be752e799', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '399e256b-5237-4799-a353-0373cce27634', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:47:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-a31f7706-976c-458a-a090-29df3210f2df req-66d1bd57-311f-4541-9158-5f6cd56d12bc tempest-TestMinimumBasicScenario-353636532 None] attachment_update completed successfully. Nov 06 19:47:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:47:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:47:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:47:50 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=11,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:47:50 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=19,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (e47e2e9d-d2df-4554-a3de-c55d04c84360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbde2c13-56f2-44f9-ba6a-cdda3b96ab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbde2c13-56f2-44f9-ba6a-cdda3b96ab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677650623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aef1649-e0d7-46b0-bda9-3bca39b1b0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:53Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af6d130-616c-45c5-b394-c559867ce60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af6d130-616c-45c5-b394-c559867ce60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e602f09-ccc2-4fea-8490-dc2265bcc63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e602f09-ccc2-4fea-8490-dc2265bcc63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aef1649-e0d7-46b0-bda9-3bca39b1b0fb', 'volume_name': 'volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158a2083-5f28-46a6-af7c-1b68d69a39c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158a2083-5f28-46a6-af7c-1b68d69a39c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16239b36-dd70-4b1b-8772-f50c7579ba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume 3aef1649-e0d7-46b0-bda9-3bca39b1b0fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb', 'volume_size': 1} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677650623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aef1649-e0d7-46b0-bda9-3bca39b1b0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:53Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Creating volume 3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:47:53 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:53 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb 1073741824 Nov 06 19:47:53 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:53 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb 1073741824" returned: 0 in 0.421s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:54 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb Nov 06 19:47:54 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:54 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16239b36-dd70-4b1b-8772-f50c7579ba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0c1e77-092d-4633-8bba-3a7e4b6cdc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:54 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb (3aef1649-e0d7-46b0-bda9-3bca39b1b0fb): created successfully Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0c1e77-092d-4633-8bba-3a7e4b6cdc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (e47e2e9d-d2df-4554-a3de-c55d04c84360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-95b6df54-5923-4b34-9d4e-e169219b5b6c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created volume successfully. Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Creating offline snapshot e03245b0-6c11-4cf6-8626-1e850aaaaa59 of volume 3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980d20a-6c35-4035-87fd-aed0d4e3e358]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:47:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:54 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb Nov 06 19:47:54 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:55 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" returned: 0 in 0.358s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:55 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 1G Nov 06 19:47:55 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:55 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 1G" returned: 0 in 0.382s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:55 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 Nov 06 19:47:55 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:55 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59" returned: 0 in 0.292s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:55 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 is being set with open permissions: ugo+rw Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:55 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 Nov 06 19:47:55 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:55 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59" returned: 0 in 0.246s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:55 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.info Nov 06 19:47:55 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:56 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.info" returned: 0 in 0.255s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:56 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.info is being set with open permissions: ugo+rw Nov 06 19:47:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:56 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.info Nov 06 19:47:56 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:56 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.info" returned: 0 in 0.233s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9ca8ef2a-09f8-46e1-a926-ec631d1beee4 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Create snapshot completed successfully Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (6279ae21-5f7f-46e0-8130-41698e146988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9f6abe-fe2a-4a59-a862-e0edf167c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9f6abe-fe2a-4a59-a862-e0edf167c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690513516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c861edf8-2dcb-437d-8825-b5cc54f71126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:57Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3c61bd-1f72-4dd2-a210-640002c96411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3c61bd-1f72-4dd2-a210-640002c96411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8293d9d1-52fc-41b8-bc5b-74f0d9f0e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8293d9d1-52fc-41b8-bc5b-74f0d9f0e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c861edf8-2dcb-437d-8825-b5cc54f71126', 'volume_name': 'volume-c861edf8-2dcb-437d-8825-b5cc54f71126', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12e5c0d-3b29-4a36-b19e-d1017c508c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12e5c0d-3b29-4a36-b19e-d1017c508c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78de1b86-dd20-467c-af79-ab210513ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume c861edf8-2dcb-437d-8825-b5cc54f71126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c861edf8-2dcb-437d-8825-b5cc54f71126', 'volume_size': 1} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690513516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c861edf8-2dcb-437d-8825-b5cc54f71126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:57Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Creating volume c861edf8-2dcb-437d-8825-b5cc54f71126 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:47:57 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:57 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 1073741824 Nov 06 19:47:57 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (4c10c66a-4703-44b0-a7c9-dfd145278255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffa7002-8004-4e83-bcde-68db3d372795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffa7002-8004-4e83-bcde-68db3d372795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809818891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ea90e7-cfbd-468a-82d8-3603e6e1b1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:58Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497a9d7e-b40d-4dea-9067-ec84c08fbd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497a9d7e-b40d-4dea-9067-ec84c08fbd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddb2204-a007-4b3d-a1a5-b886d2209fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddb2204-a007-4b3d-a1a5-b886d2209fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ea90e7-cfbd-468a-82d8-3603e6e1b1e0', 'volume_name': 'volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fdef08-55ee-4f87-a938-b02676c55fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fdef08-55ee-4f87-a938-b02676c55fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8781ff7-6f85-4ff5-9651-f5bfcb4953f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:57 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume 64ea90e7-cfbd-468a-82d8-3603e6e1b1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0', 'volume_size': 1} Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:57 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 1073741824" returned: 0 in 0.623s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:58 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 Nov 06 19:47:58 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (38b08b4b-2315-458e-83d7-05e5a652a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a475f7-bd6f-417f-a1f2-0b8e13a80a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a475f7-bd6f-417f-a1f2-0b8e13a80a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424546249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b813ac73-4e99-4acd-b5da-4485bf7ad1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:58Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03968c55-b526-40d0-8b04-a0b5836362ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03968c55-b526-40d0-8b04-a0b5836362ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed1cf86-53b4-4a4a-985f-aee57fb412c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed1cf86-53b4-4a4a-985f-aee57fb412c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b813ac73-4e99-4acd-b5da-4485bf7ad1ae', 'volume_name': 'volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede9d690-205f-431b-9592-e7f8352146b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede9d690-205f-431b-9592-e7f8352146b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69f55b4-4cf4-48df-b42e-7db4def4fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume b813ac73-4e99-4acd-b5da-4485bf7ad1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae', 'volume_size': 1} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:58 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126" returned: 0 in 0.374s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809818891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ea90e7-cfbd-468a-82d8-3603e6e1b1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:58Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Creating volume 64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:47:58 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78de1b86-dd20-467c-af79-ab210513ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c861edf8-2dcb-437d-8825-b5cc54f71126', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd51b95-a421-4452-9682-610c7468773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 1073741824 Nov 06 19:47:58 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:58 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume volume-c861edf8-2dcb-437d-8825-b5cc54f71126 (c861edf8-2dcb-437d-8825-b5cc54f71126): created successfully Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd51b95-a421-4452-9682-610c7468773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (6279ae21-5f7f-46e0-8130-41698e146988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (610a0e46-fdfb-4be2-996c-605536775385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40015b9b-1f47-4ab7-acf0-3918f793c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e23777fc-fe10-4fae-98e6-b5a0d8eed412 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created volume successfully. Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40015b9b-1f47-4ab7-acf0-3918f793c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434833055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba3cbee-3609-41e4-9b7d-dfc2354923fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:58Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd81c08-54f4-4325-ad65-4a19ae72497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd81c08-54f4-4325-ad65-4a19ae72497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c275ba7-3a3e-450a-87d8-f4fd8f89c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c275ba7-3a3e-450a-87d8-f4fd8f89c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba3cbee-3609-41e4-9b7d-dfc2354923fe', 'volume_name': 'volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74530edc-2198-4f12-95a9-b9cf0eaca04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74530edc-2198-4f12-95a9-b9cf0eaca04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5ecb9a-8830-4175-b294-0cb938aad6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:58 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume bba3cbee-3609-41e4-9b7d-dfc2354923fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe', 'volume_size': 1} Nov 06 19:47:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:58 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 1073741824" returned: 0 in 0.590s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:59 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 Nov 06 19:47:59 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (b72c30c4-ebf9-4496-b406-770bc844f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3613ec2e-8137-4654-a296-7602f58cfc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3613ec2e-8137-4654-a296-7602f58cfc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602688919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feaca9e6-ac33-49b2-b80d-0f267d821b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:59Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfda0673-e54d-4642-b4ec-8c0b6211024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfda0673-e54d-4642-b4ec-8c0b6211024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d4919a-6487-4f40-a09e-f5e0779e81f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d4919a-6487-4f40-a09e-f5e0779e81f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feaca9e6-ac33-49b2-b80d-0f267d821b87', 'volume_name': 'volume-feaca9e6-ac33-49b2-b80d-0f267d821b87', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59581096-3c3a-4ab6-ba52-15ae69a4f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59581096-3c3a-4ab6-ba52-15ae69a4f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a820db3-08ff-499e-8776-772d1693ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:59 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume feaca9e6-ac33-49b2-b80d-0f267d821b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feaca9e6-ac33-49b2-b80d-0f267d821b87', 'volume_size': 1} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:59 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0" returned: 0 in 0.259s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.128s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424546249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b813ac73-4e99-4acd-b5da-4485bf7ad1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:58Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Creating volume b813ac73-4e99-4acd-b5da-4485bf7ad1ae {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:47:59 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8781ff7-6f85-4ff5-9651-f5bfcb4953f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:59 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae 1073741824 Nov 06 19:47:59 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5165be2b-037f-40b9-8972-61bc3997475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:47:59 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 (64ea90e7-cfbd-468a-82d8-3603e6e1b1e0): created successfully Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5165be2b-037f-40b9-8972-61bc3997475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (4c10c66a-4703-44b0-a7c9-dfd145278255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:47:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f805f24e-1c8a-4288-93f3-532c8cb32b8b tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created volume successfully. Nov 06 19:47:59 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae 1073741824" returned: 0 in 0.429s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:47:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:47:59 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae Nov 06 19:47:59 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:00 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae" returned: 0 in 0.249s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.412s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434833055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba3cbee-3609-41e4-9b7d-dfc2354923fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:58Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Creating volume bba3cbee-3609-41e4-9b7d-dfc2354923fe {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:00 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69f55b4-4cf4-48df-b42e-7db4def4fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:00 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe 1073741824 Nov 06 19:48:00 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694939bb-92fb-4ad7-a3ce-3b03ae0cada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:00 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae (b813ac73-4e99-4acd-b5da-4485bf7ad1ae): created successfully Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694939bb-92fb-4ad7-a3ce-3b03ae0cada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (38b08b4b-2315-458e-83d7-05e5a652a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d8e0b884-1ba5-4781-931d-bbd1c86bd18c tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created volume successfully. Nov 06 19:48:00 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe 1073741824" returned: 0 in 0.393s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:00 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe Nov 06 19:48:00 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:00 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe" returned: 0 in 0.241s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602688919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feaca9e6-ac33-49b2-b80d-0f267d821b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0264e14145548b1926586e15f3ef493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:47:59Z,use_quota=True,user_id='2ff840ebcf3a462dac225f2d88297a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Creating volume feaca9e6-ac33-49b2-b80d-0f267d821b87 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:00 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5ecb9a-8830-4175-b294-0cb938aad6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:00 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 1073741824 Nov 06 19:48:00 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff447930-868a-43c0-8c11-c069d2f791b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:00 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe (bba3cbee-3609-41e4-9b7d-dfc2354923fe): created successfully Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff447930-868a-43c0-8c11-c069d2f791b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (610a0e46-fdfb-4be2-996c-605536775385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4fbcd0e5-b1a8-4bc8-a0c4-c4a645338348 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created volume successfully. Nov 06 19:48:01 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 1073741824" returned: 0 in 0.437s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:01 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 Nov 06 19:48:01 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:01 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87" returned: 0 in 0.276s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a820db3-08ff-499e-8776-772d1693ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feaca9e6-ac33-49b2-b80d-0f267d821b87', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c49ecd-2134-4d57-9ea8-9e27282aecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:01 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Volume volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 (feaca9e6-ac33-49b2-b80d-0f267d821b87): created successfully Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c49ecd-2134-4d57-9ea8-9e27282aecfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Flow 'volume_create_manager' (b72c30c4-ebf9-4496-b406-770bc844f671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0ca3df82-9c73-4be9-ae27-3dd2a8ce357d tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created volume successfully. Nov 06 19:48:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-feaca9e6-ac33-49b2-b80d-0f267d821b87-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-feaca9e6-ac33-49b2-b80d-0f267d821b87-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-feaca9e6-ac33-49b2-b80d-0f267d821b87" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-feaca9e6-ac33-49b2-b80d-0f267d821b87" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:02 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b0988-4fb1-47ba-b151-a3fb157f7f4c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:02 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 Nov 06 19:48:02 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:03 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87" returned: 0 in 0.427s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:03 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87 Nov 06 19:48:03 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:03 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-feaca9e6-ac33-49b2-b80d-0f267d821b87" returned: 0 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-feaca9e6-ac33-49b2-b80d-0f267d821b87" released by "delete_volume" :: held 0.804s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created reservations ['985105ec-b3c9-4670-b1dc-884d6a7c4133', '8f24ac31-ed7c-4d95-8b85-efaa04e9ed0a', 'd8b62850-0a97-4c1b-9e8e-a34b466a19e5', '3d68b058-2fd7-4ec1-8634-b8397229f031'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:03 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:03 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-9ef358fa-8ac0-44c4-bb44-91d00b7bc596 req-76b8ce35-c3ee-4b8e-b035-bd0590122dca tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-9ef358fa-8ac0-44c4-bb44-91d00b7bc596 req-76b8ce35-c3ee-4b8e-b035-bd0590122dca tempest-TestStampPattern-1152151569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-9ef358fa-8ac0-44c4-bb44-91d00b7bc596 req-76b8ce35-c3ee-4b8e-b035-bd0590122dca tempest-TestStampPattern-1152151569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-9ef358fa-8ac0-44c4-bb44-91d00b7bc596 req-76b8ce35-c3ee-4b8e-b035-bd0590122dca tempest-TestStampPattern-1152151569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7be36b23-916d-4cb9-894a-b2d0cb8dd5c3', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-bba3cbee-3609-41e4-9b7d-dfc2354923fe-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-bba3cbee-3609-41e4-9b7d-dfc2354923fe-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-9ef358fa-8ac0-44c4-bb44-91d00b7bc596 req-76b8ce35-c3ee-4b8e-b035-bd0590122dca tempest-TestStampPattern-1152151569 None] attachment_update completed successfully. Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-bba3cbee-3609-41e4-9b7d-dfc2354923fe" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-bba3cbee-3609-41e4-9b7d-dfc2354923fe" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd1976-0cee-413c-acc4-490ef2b31bb5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:03 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.378s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Deleted volume successfully. Nov 06 19:48:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-e37d9e88-775a-45da-a457-011b6d205ef5 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-feaca9e6-ac33-49b2-b80d-0f267d821b87-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:04 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe Nov 06 19:48:04 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:04 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe" returned: 0 in 0.458s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:04 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe Nov 06 19:48:04 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:04 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bba3cbee-3609-41e4-9b7d-dfc2354923fe" returned: 0 in 0.311s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-bba3cbee-3609-41e4-9b7d-dfc2354923fe" released by "delete_volume" :: held 0.833s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created reservations ['083bb366-38a3-421f-870f-2f7a9af0856d', '5cba8a69-4d59-4fa3-acbd-12b53415c76f', 'f49223e7-6c47-48c9-89ad-eaafb18aecaf', 'a940030a-ab34-4f07-8291-0a56052645dd'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:04 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:04 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-b813ac73-4e99-4acd-b5da-4485bf7ad1ae-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-b813ac73-4e99-4acd-b5da-4485bf7ad1ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-b813ac73-4e99-4acd-b5da-4485bf7ad1ae" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-b813ac73-4e99-4acd-b5da-4485bf7ad1ae" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a87330f-ce58-4b04-bc85-81c684f4baf0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:05 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Deleted volume successfully. Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-44004f28-0513-4f7f-ab8e-61dde5239afb tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-bba3cbee-3609-41e4-9b7d-dfc2354923fe-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:05 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae Nov 06 19:48:05 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:05 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae" returned: 0 in 0.414s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:05 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae Nov 06 19:48:05 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:05 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b813ac73-4e99-4acd-b5da-4485bf7ad1ae" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-b813ac73-4e99-4acd-b5da-4485bf7ad1ae" released by "delete_volume" :: held 0.725s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created reservations ['1e64a141-4d1e-4bf7-b192-09fa70335097', '7a1093aa-c89c-4841-acb4-f1f6600896ab', 'df7c46f4-dd77-4cd5-9a5f-92443968b30b', 'f8ab6c05-c1dc-456c-b102-f26aee0d3242'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:05 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:05 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:06 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.284s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Deleted volume successfully. Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7014aeec-83a6-4f9f-902d-5bf47b65372a tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-b813ac73-4e99-4acd-b5da-4485bf7ad1ae-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d7c06-9fdf-4b89-a148-d67409c432d0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:06 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 Nov 06 19:48:06 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:06 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0" returned: 0 in 0.466s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:06 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0 Nov 06 19:48:06 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:07 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0" returned: 0 in 0.312s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0" released by "delete_volume" :: held 0.823s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created reservations ['cba61690-c8ae-4bf4-9cb4-240834f07fe4', 'd28e52ef-5e4a-4c1c-90a1-a620518b4e61', '59f33ba2-4284-46d5-9725-b70134c7f1ce', '8e3a186e-dbee-47e1-8354-4441b7b7770b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:07 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:07 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-c861edf8-2dcb-437d-8825-b5cc54f71126-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-c861edf8-2dcb-437d-8825-b5cc54f71126-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-c861edf8-2dcb-437d-8825-b5cc54f71126" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-c861edf8-2dcb-437d-8825-b5cc54f71126" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae823a-14e4-415d-b53d-ee0779425f2c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:07 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:07 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Deleted volume successfully. Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46c5d97a-c879-476e-a98d-66a1d95e01a9 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-64ea90e7-cfbd-468a-82d8-3603e6e1b1e0-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:07 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 Nov 06 19:48:07 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:07 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126" returned: 0 in 0.422s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:08 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126 Nov 06 19:48:08 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:08 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c861edf8-2dcb-437d-8825-b5cc54f71126" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-c861edf8-2dcb-437d-8825-b5cc54f71126" released by "delete_volume" :: held 0.795s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created reservations ['2398a20b-8f52-4892-b797-b874600b6eff', '5aad8f5d-efe4-4b31-a585-6c24bf7a55c6', '983786e9-66eb-4c6c-8a18-b8653cf1bd87', '61b674f1-72df-41f1-ae47-7d257a7a8b44'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:08 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:08 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-e03245b0-6c11-4cf6-8626-1e850aaaaa59-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-e03245b0-6c11-4cf6-8626-1e850aaaaa59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-e03245b0-6c11-4cf6-8626-1e850aaaaa59" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:08 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-e03245b0-6c11-4cf6-8626-1e850aaaaa59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Deleting offline snapshot e03245b0-6c11-4cf6-8626-1e850aaaaa59 of volume 3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] snapshot_file for this snap is: volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.325s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Deleted volume successfully. Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8ac675-8a41-45a7-ba6f-c42ade345572]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d98eb57f-ac0d-47a9-9285-958d42ff2509 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-c861edf8-2dcb-437d-8825-b5cc54f71126-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:08 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 Nov 06 19:48:08 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:09 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59" returned: 0 in 0.428s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf6bcbe-2a94-44d9-8534-e24b0462cfe8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:09 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb Nov 06 19:48:09 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:09 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-dc8fd922-be15-4349-87c7-a36f7f2fe2e2 req-2f7141e7-0646-428a-b142-189ab26818b4 tempest-TestStampPattern-1152151569 None] Terminate volume connection completed successfully. Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-dc8fd922-be15-4349-87c7-a36f7f2fe2e2 req-2f7141e7-0646-428a-b142-189ab26818b4 tempest-TestStampPattern-1152151569 None] Deleting attachment 7be36b23-916d-4cb9-894a-b2d0cb8dd5c3. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:48:09 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" returned: 0 in 0.379s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:09 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 Nov 06 19:48:09 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:09 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59" returned: 0 in 0.355s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:10 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59 Nov 06 19:48:10 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:10 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb.e03245b0-6c11-4cf6-8626-1e850aaaaa59" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-e03245b0-6c11-4cf6-8626-1e850aaaaa59" released by "_delete_snapshot" :: held 1.552s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" released by "delete_snapshot" :: held 1.579s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created reservations ['ce86017d-29a9-41b2-8e3d-3c79c36bdd53', 'd939c213-3440-471f-96ec-163be846c553', '069e5daa-e8f1-45da-93c8-e9d39e540c19', 'd18abcd7-847e-45aa-89bf-3d2500fe8ee4'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Delete snapshot completed successfully. Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a64da564-e8e4-442d-a1c4-f404af848741 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-e03245b0-6c11-4cf6-8626-1e850aaaaa59-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Creating offline snapshot 5f57c82b-a78a-4f2e-998b-13720077e559 of volume 9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69f520c-589b-4c7d-80f1-0d47eee9b9bd]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:10 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 Nov 06 19:48:10 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "cinder-quobyte-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc83628-da46-437d-ac3b-db406b9b9655]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:11 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" returned: 0 in 0.461s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:11 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 1G Nov 06 19:48:11 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:11 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb Nov 06 19:48:11 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:11 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" returned: 0 in 0.412s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:11 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb Nov 06 19:48:11 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:11 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 1G" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:11 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 Nov 06 19:48:11 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:11 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-quobyte-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb" released by "delete_volume" :: held 0.768s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Created reservations ['898d7a4c-da4d-4e27-8569-7a3932bae598', '51e04a3d-f809-4c6e-9193-ac291db46cf0', '1f9f5a10-2a28-4538-b930-5b5e3264cf83', '83ff9cdf-3ac3-48a5-b458-0a6c757edfbf'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:11 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559" returned: 0 in 0.369s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:11 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 is being set with open permissions: ugo+rw Nov 06 19:48:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:11 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:11 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:11 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 Nov 06 19:48:11 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:12 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:12 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Deleted volume successfully. Nov 06 19:48:12 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b0871b9e-f65d-400e-93f7-084719d33e52 tempest-CreateVolumesFromSnapshotTest-1747510864 None] Lock "cinder-3aef1649-e0d7-46b0-bda9-3bca39b1b0fb-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:12 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.info Nov 06 19:48:12 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:12 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.info" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:12 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.info is being set with open permissions: ugo+rw Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:12 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.info Nov 06 19:48:12 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:12 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.info" returned: 0 in 0.308s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:12 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-87b6d33d-f6c9-4f1d-8702-e6b5ce97143e tempest-TestStampPattern-1152151569 None] Create snapshot completed successfully Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (1dbd68b4-ff6b-4a84-9a48-4a73c9ad2f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5627461b-8ffb-4afa-8f59-3da0dcb564d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5627461b-8ffb-4afa-8f59-3da0dcb564d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567357539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa47ed-c0fd-4056-a9e1-f08450885f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:15Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d789b409-12d3-405a-9910-b83c22595d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d789b409-12d3-405a-9910-b83c22595d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0ec529-e930-4764-85ed-4e8ad3f2f0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0ec529-e930-4764-85ed-4e8ad3f2f0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fa47ed-c0fd-4056-a9e1-f08450885f32', 'volume_name': 'volume-82fa47ed-c0fd-4056-a9e1-f08450885f32', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8466e86-5be3-4f10-bc65-eb1df82ca2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8466e86-5be3-4f10-bc65-eb1df82ca2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b46998-5246-4f7d-8f44-4a607a1cd91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:15 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume 82fa47ed-c0fd-4056-a9e1-f08450885f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fa47ed-c0fd-4056-a9e1-f08450885f32', 'volume_size': 1} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567357539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa47ed-c0fd-4056-a9e1-f08450885f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:15Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Creating volume 82fa47ed-c0fd-4056-a9e1-f08450885f32 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:15 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:15 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 1073741824 Nov 06 19:48:15 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:15 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 1073741824" returned: 0 in 0.512s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:15 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 Nov 06 19:48:15 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:16 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b46998-5246-4f7d-8f44-4a607a1cd91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fa47ed-c0fd-4056-a9e1-f08450885f32', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf65de5-69cb-48e1-98b1-0f7e7ad4020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:16 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 (82fa47ed-c0fd-4056-a9e1-f08450885f32): created successfully Nov 06 19:48:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf65de5-69cb-48e1-98b1-0f7e7ad4020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:16 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (1dbd68b4-ff6b-4a84-9a48-4a73c9ad2f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:16 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-255aa138-9879-42f7-8870-f5e61612c2fd tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created volume successfully. Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (295712fb-d9fc-4b8d-b331-4a77c5685a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1d0f5d-cd67-4a74-876b-382ce3aece2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1d0f5d-cd67-4a74-876b-382ce3aece2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1188763161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2421e3d2-5c44-4236-a06c-88e7fb37908f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:18Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458fc5cc-9c46-4d6c-8af1-2d57526a6616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458fc5cc-9c46-4d6c-8af1-2d57526a6616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ab470-269b-439d-96b7-9e8a85c203c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ab470-269b-439d-96b7-9e8a85c203c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2421e3d2-5c44-4236-a06c-88e7fb37908f', 'volume_name': 'volume-2421e3d2-5c44-4236-a06c-88e7fb37908f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5a549b-8fd4-4c8a-b5a5-8c6e0d1eb9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5a549b-8fd4-4c8a-b5a5-8c6e0d1eb9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498a2953-7a31-49fd-a4f8-489c83baea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:17 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume 2421e3d2-5c44-4236-a06c-88e7fb37908f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2421e3d2-5c44-4236-a06c-88e7fb37908f', 'volume_size': 1} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1188763161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2421e3d2-5c44-4236-a06c-88e7fb37908f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:18Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Creating volume 2421e3d2-5c44-4236-a06c-88e7fb37908f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:17 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:17 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f 1073741824 Nov 06 19:48:17 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (4a8dbc74-07c1-4ab9-a2d2-6fbc2be4875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5508a272-06ba-45f7-ab82-d6961a666df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5508a272-06ba-45f7-ab82-d6961a666df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37084613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989f6a66-f2bd-441e-b1fb-20fdd3ea3541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:18Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fa0414-e374-401a-91d9-fe0389e92fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fa0414-e374-401a-91d9-fe0389e92fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478b3ad2-0c37-4092-9d42-426802dfaf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478b3ad2-0c37-4092-9d42-426802dfaf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989f6a66-f2bd-441e-b1fb-20fdd3ea3541', 'volume_name': 'volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db36ab54-72d6-4e71-bd3a-8e1b9898158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db36ab54-72d6-4e71-bd3a-8e1b9898158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e148fd62-140e-4e77-a8d8-5e6f57d149d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume 989f6a66-f2bd-441e-b1fb-20fdd3ea3541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541', 'volume_size': 1} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:18 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f 1073741824" returned: 0 in 0.590s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:18 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f Nov 06 19:48:18 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (899c827b-7780-4b12-904c-7408ed2f248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0803200c-dce1-4348-9d58-75eabe1a78ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0803200c-dce1-4348-9d58-75eabe1a78ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22906000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e84f0-1997-41ae-9b1f-36020d83cd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:19Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50f0ff3-de9a-464f-a000-2cbe6540133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50f0ff3-de9a-464f-a000-2cbe6540133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c15cd2-cbc2-4c42-9e88-d2ef4a38524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c15cd2-cbc2-4c42-9e88-d2ef4a38524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657e84f0-1997-41ae-9b1f-36020d83cd06', 'volume_name': 'volume-657e84f0-1997-41ae-9b1f-36020d83cd06', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e38dca-1a4c-4d05-879a-f70f630b4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e38dca-1a4c-4d05-879a-f70f630b4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213bedad-1b8d-4482-973a-873d2a80b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume 657e84f0-1997-41ae-9b1f-36020d83cd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657e84f0-1997-41ae-9b1f-36020d83cd06', 'volume_size': 1} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f" returned: 0 in 0.312s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37084613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989f6a66-f2bd-441e-b1fb-20fdd3ea3541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:18Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Creating volume 989f6a66-f2bd-441e-b1fb-20fdd3ea3541 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:18 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498a2953-7a31-49fd-a4f8-489c83baea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2421e3d2-5c44-4236-a06c-88e7fb37908f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a52c8a-3c18-46fa-979e-739257fff4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:18 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 1073741824 Nov 06 19:48:18 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume volume-2421e3d2-5c44-4236-a06c-88e7fb37908f (2421e3d2-5c44-4236-a06c-88e7fb37908f): created successfully Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a52c8a-3c18-46fa-979e-739257fff4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (295712fb-d9fc-4b8d-b331-4a77c5685a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:18 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-5c1f75a3-ac04-400c-8df4-61f80be32782 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created volume successfully. Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (c8697978-d650-4f3c-b6e6-320d2b2eea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2a3880-a815-4120-93bf-f109a3da1ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2a3880-a815-4120-93bf-f109a3da1ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789786162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd6dd32-e3a3-4505-92c4-f3e754d1ec89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:19Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e42722-2248-43bb-a2f8-39216a464d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e42722-2248-43bb-a2f8-39216a464d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd18862-fbc6-4e27-90ea-b3a107fdaec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd18862-fbc6-4e27-90ea-b3a107fdaec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd6dd32-e3a3-4505-92c4-f3e754d1ec89', 'volume_name': 'volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3739003f-4e24-405a-aa2a-f4dc05afcdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3739003f-4e24-405a-aa2a-f4dc05afcdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d089cd00-5d70-449d-b47d-2ad1abd9933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume ccd6dd32-e3a3-4505-92c4-f3e754d1ec89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89', 'volume_size': 1} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:19 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 1073741824" returned: 0 in 0.629s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:19 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 Nov 06 19:48:19 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (142c7f84-adee-4baf-96eb-2b8d3c7505b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551cd968-4abd-4114-8c13-4cd9b5d935ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551cd968-4abd-4114-8c13-4cd9b5d935ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035289806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44313766-1aea-4eb9-a5c9-8dfc36ad855d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:20Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2840d9cc-1dc6-4f35-a789-e2de6dba359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2840d9cc-1dc6-4f35-a789-e2de6dba359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e9dd1a-569a-4fdb-bee8-a6f6fdd1c07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e9dd1a-569a-4fdb-bee8-a6f6fdd1c07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44313766-1aea-4eb9-a5c9-8dfc36ad855d', 'volume_name': 'volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fdcebf-9366-422a-906f-4fbbbc8eae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fdcebf-9366-422a-906f-4fbbbc8eae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d488b8-9c63-4ed8-a52e-0942e86c0442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume 44313766-1aea-4eb9-a5c9-8dfc36ad855d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d', 'volume_size': 1} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:19 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541" returned: 0 in 0.313s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-22906000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657e84f0-1997-41ae-9b1f-36020d83cd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:19Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Creating volume 657e84f0-1997-41ae-9b1f-36020d83cd06 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:19 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e148fd62-140e-4e77-a8d8-5e6f57d149d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57b3ebf-a0ec-47f6-93c2-900bc2d7a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:19 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 1073741824 Nov 06 19:48:19 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:19 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 (989f6a66-f2bd-441e-b1fb-20fdd3ea3541): created successfully Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57b3ebf-a0ec-47f6-93c2-900bc2d7a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (4a8dbc74-07c1-4ab9-a2d2-6fbc2be4875c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:19 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b832dea4-e734-46eb-8bc7-2261cd9f927e tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created volume successfully. Nov 06 19:48:20 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 1073741824" returned: 0 in 0.500s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:20 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 Nov 06 19:48:20 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:20 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06" returned: 0 in 0.258s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.339s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789786162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd6dd32-e3a3-4505-92c4-f3e754d1ec89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:19Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Creating volume ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:20 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:20 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 1073741824 Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213bedad-1b8d-4482-973a-873d2a80b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657e84f0-1997-41ae-9b1f-36020d83cd06', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:20 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40669cb-cc4b-445c-bcb6-4711e4dc27cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:20 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume volume-657e84f0-1997-41ae-9b1f-36020d83cd06 (657e84f0-1997-41ae-9b1f-36020d83cd06): created successfully Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40669cb-cc4b-445c-bcb6-4711e4dc27cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (899c827b-7780-4b12-904c-7408ed2f248f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:20 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-482803c2-20ef-43f0-a671-9d4c8649b357 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created volume successfully. Nov 06 19:48:21 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 1073741824" returned: 0 in 0.422s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:21 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 Nov 06 19:48:21 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:21 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89" returned: 0 in 0.249s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035289806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44313766-1aea-4eb9-a5c9-8dfc36ad855d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59dc5ae9821b4acb883c3fec35979780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:20Z,use_quota=True,user_id='7c4bd5c73d5a415aaaa6df6fe76bafcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Creating volume 44313766-1aea-4eb9-a5c9-8dfc36ad855d {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:21 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d089cd00-5d70-449d-b47d-2ad1abd9933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:21 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d 1073741824 Nov 06 19:48:21 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb96f28c-011a-441a-ad18-f860a345982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:21 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 (ccd6dd32-e3a3-4505-92c4-f3e754d1ec89): created successfully Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb96f28c-011a-441a-ad18-f860a345982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (c8697978-d650-4f3c-b6e6-320d2b2eea85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6337b0e7-de66-48c5-81cc-bbc9f426fa0c tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created volume successfully. Nov 06 19:48:21 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d 1073741824" returned: 0 in 0.463s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:21 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d Nov 06 19:48:21 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Flow 'volume_create_manager' (f125fd7d-3cf3-46e6-b30d-96c41e7ce6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f04cc3-f2a3-4594-b9ce-1648b8c8d042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f04cc3-f2a3-4594-b9ce-1648b8c8d042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1490485348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8511fd81e82642179e464e192175fc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f57c82b-a78a-4f2e-998b-13720077e559,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:22Z,use_quota=True,user_id='874fa9f5f865402ba7d00cf24e0afba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266a4ae6-b000-4175-be73-4b3b2bb222b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266a4ae6-b000-4175-be73-4b3b2bb222b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2aa0221-9150-49ed-b546-2aa0d3d001d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2aa0221-9150-49ed-b546-2aa0d3d001d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6', 'volume_name': 'volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6', 'volume_size': 1, 'snapshot_id': '5f57c82b-a78a-4f2e-998b-13720077e559'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:22 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b6880b-3032-427c-9f28-aa05411de6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b6880b-3032-427c-9f28-aa05411de6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b9a233-a559-45b6-afc9-c8b6e345a219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:22 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Volume cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6', 'volume_size': 1, 'snapshot_id': '5f57c82b-a78a-4f2e-998b-13720077e559'} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d" returned: 0 in 0.315s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-quobyte-5f57c82b-a78a-4f2e-998b-13720077e559-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d488b8-9c63-4ed8-a52e-0942e86c0442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88213ec8-8936-432b-a39a-1ce81bad4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-5f57c82b-a78a-4f2e-998b-13720077e559-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Creating volume cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 from snapshot 5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-quobyte-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:22 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Volume volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d (44313766-1aea-4eb9-a5c9-8dfc36ad855d): created successfully Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88213ec8-8936-432b-a39a-1ce81bad4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Flow 'volume_create_manager' (142c7f84-adee-4baf-96eb-2b8d3c7505b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] snapshot: 5f57c82b-a78a-4f2e-998b-13720077e559, volume: cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:48:22 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a17c02f5-03a8-4c74-b04e-3e8e22bbfced tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created volume successfully. Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[794c2cd6-26d9-4ed7-97a9-666bec7ac10d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:22 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 Nov 06 19:48:22 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:22 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[38727392-94be-4a48-8e62-145740fb706f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:22 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 Nov 06 19:48:22 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:23 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-44313766-1aea-4eb9-a5c9-8dfc36ad855d-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" returned: 0 in 0.404s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:23 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 Nov 06 19:48:23 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-44313766-1aea-4eb9-a5c9-8dfc36ad855d-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-quobyte-44313766-1aea-4eb9-a5c9-8dfc36ad855d" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-44313766-1aea-4eb9-a5c9-8dfc36ad855d" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7149b-5655-4e6e-bf63-5e0af744eea5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:23 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d Nov 06 19:48:23 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:23 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d" returned: 0 in 0.509s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:23 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d Nov 06 19:48:23 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:24 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-44313766-1aea-4eb9-a5c9-8dfc36ad855d" returned: 0 in 0.452s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-44313766-1aea-4eb9-a5c9-8dfc36ad855d" released by "delete_volume" :: held 1.030s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created reservations ['6d9a1fdd-8286-4ba2-89ee-b89a42e867d8', 'e4862a48-14d9-4ffb-87a0-7e3305ce9d14', '4e03e67f-accc-455b-af10-5c69bad2ced5', '6f8c2397-4e20-45b1-8974-dff7ca2f11a2'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:24 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:24 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:25 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.538s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Deleted volume successfully. Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c4fa64c8-645e-4e6f-9233-41b0ab5ea0fe tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-44313766-1aea-4eb9-a5c9-8dfc36ad855d-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-quobyte-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89" acquired by "delete_volume" :: waited 0.045s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74050b3-4503-4761-8509-25dcd4a97588]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:26 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 Nov 06 19:48:26 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:27 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89" returned: 0 in 1.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:27 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89 Nov 06 19:48:27 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:27 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89" returned: 0 in 0.593s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89" released by "delete_volume" :: held 2.077s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:27 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created reservations ['71faf082-1c5a-4e47-a51c-a2045e2c29f8', 'c92cb088-9ceb-4f30-9ee6-269edd960ef8', 'febdf950-4e63-42c9-bc1a-b5c7f9d63d72', '4ef5f80a-8546-4fc5-b651-879597520134'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:28 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:28 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:28 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.407s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Deleted volume successfully. Nov 06 19:48:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa8c6d7-46bd-487f-8da6-0af464808829 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-ccd6dd32-e3a3-4505-92c4-f3e754d1ec89-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-657e84f0-1997-41ae-9b1f-36020d83cd06-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-657e84f0-1997-41ae-9b1f-36020d83cd06-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-quobyte-657e84f0-1997-41ae-9b1f-36020d83cd06" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-657e84f0-1997-41ae-9b1f-36020d83cd06" acquired by "delete_volume" :: waited 0.036s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:29 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0464053-881d-4a14-b0f9-c0fb20bfd703]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:29 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 Nov 06 19:48:29 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:30 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06" returned: 0 in 0.799s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:30 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06 Nov 06 19:48:30 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:31 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-657e84f0-1997-41ae-9b1f-36020d83cd06" returned: 0 in 0.632s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-657e84f0-1997-41ae-9b1f-36020d83cd06" released by "delete_volume" :: held 1.540s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created reservations ['42e76e22-88c4-41b8-a9d9-6079883a1439', '57e9b3c7-3984-4bde-a911-d64cd38baea7', 'ffe54910-263a-4bed-8bfd-118931b48445', '14aba3d0-90c2-4f68-bba1-243f9dbe31b0'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:31 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:31 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-989f6a66-f2bd-441e-b1fb-20fdd3ea3541-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-989f6a66-f2bd-441e-b1fb-20fdd3ea3541-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-quobyte-989f6a66-f2bd-441e-b1fb-20fdd3ea3541" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:32 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.698s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-989f6a66-f2bd-441e-b1fb-20fdd3ea3541" acquired by "delete_volume" :: waited 0.044s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Deleted volume successfully. Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f7438e4d-29b2-420b-9f87-25ef07907ca9 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-657e84f0-1997-41ae-9b1f-36020d83cd06-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad987fd0-e17f-4d33-aedc-3d79487aedc0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:32 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 Nov 06 19:48:32 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:33 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" returned: 0 in 10.103s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10, size 1024.00 MB, duration 10.10 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:48:33 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Converted 1024.00 MB image at 101.34 MB/s Nov 06 19:48:33 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 is being set with open permissions: ugo+rw Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:33 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541" returned: 0 in 1.010s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:33 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 Nov 06 19:48:33 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:33 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541 Nov 06 19:48:33 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:33 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" returned: 0 in 0.438s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" released by "_copy_volume_from_snapshot" :: held 11.443s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:33 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-989f6a66-f2bd-441e-b1fb-20fdd3ea3541" returned: 0 in 0.497s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-5f57c82b-a78a-4f2e-998b-13720077e559-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" released by "_create_volume_from_snapshot" :: held 11.562s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.594s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-989f6a66-f2bd-441e-b1fb-20fdd3ea3541" released by "delete_volume" :: held 1.641s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b9a233-a559-45b6-afc9-c8b6e345a219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6', 'volume_size': 1, 'snapshot_id': '5f57c82b-a78a-4f2e-998b-13720077e559'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab8cc1c-ab7b-48d4-90b8-3b5ed1fd7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Volume volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 (cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6): created successfully Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab8cc1c-ab7b-48d4-90b8-3b5ed1fd7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Flow 'volume_create_manager' (f125fd7d-3cf3-46e6-b30d-96c41e7ce6c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-34dc2dc0-f951-4f60-a0be-f68a24da1c45 tempest-TestStampPattern-1152151569 None] Created volume successfully. Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created reservations ['34a2e8dc-bdac-4540-a312-4c5abf04be71', 'd26409ee-b7e8-42fe-a028-4d9df28114a4', '2c928860-48a6-48b1-8921-7bdac7ae9e31', 'c1ad01ba-7890-494e-ac5f-2388a0a50828'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:34 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:34 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:34 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:34 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Deleted volume successfully. Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-fd8ced8f-723d-4bc1-a2f7-e9563c61e08b tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-989f6a66-f2bd-441e-b1fb-20fdd3ea3541-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-2421e3d2-5c44-4236-a06c-88e7fb37908f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-2421e3d2-5c44-4236-a06c-88e7fb37908f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-quobyte-2421e3d2-5c44-4236-a06c-88e7fb37908f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-2421e3d2-5c44-4236-a06c-88e7fb37908f" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac79f858-f318-4e31-886e-bccd9db8b1e3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:34 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f Nov 06 19:48:34 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:34 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f" returned: 0 in 0.470s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:35 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f Nov 06 19:48:35 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:35 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2421e3d2-5c44-4236-a06c-88e7fb37908f" returned: 0 in 0.283s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-2421e3d2-5c44-4236-a06c-88e7fb37908f" released by "delete_volume" :: held 0.810s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created reservations ['c3bcf6fe-a1de-4036-9b71-8866ccc5d55a', 'fc829f48-3fe8-47e6-87a2-e576c18e7ce1', '84809181-abee-4296-b2f8-8bdc733313f8', '94a39028-7c47-4983-aa5d-55fde6691c14'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:35 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:35 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-82fa47ed-c0fd-4056-a9e1-f08450885f32-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-82fa47ed-c0fd-4056-a9e1-f08450885f32-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "cinder-quobyte-82fa47ed-c0fd-4056-a9e1-f08450885f32" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-82fa47ed-c0fd-4056-a9e1-f08450885f32" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:35 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.297s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Deleted volume successfully. Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fe7a7-f87e-451f-8e3c-e088cbea3e5d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-74f578ba-f818-4302-b241-00f3928511c2 tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-2421e3d2-5c44-4236-a06c-88e7fb37908f-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:35 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 Nov 06 19:48:35 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:36 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:36 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32 Nov 06 19:48:36 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:36 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-82fa47ed-c0fd-4056-a9e1-f08450885f32" returned: 0 in 0.278s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-quobyte-82fa47ed-c0fd-4056-a9e1-f08450885f32" released by "delete_volume" :: held 0.778s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Created reservations ['971e60dd-6584-4c19-9ff8-92be7d9494db', '854d578a-cd7d-45f8-9a28-28d37bccb567', 'bb696769-4751-437e-a58e-f78ba86e7e93', 'ea390ca6-ab56-4f5a-88c2-5f173b79e818'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:36 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:36 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:36 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Deleted volume successfully. Nov 06 19:48:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-407d0668-71f1-4a45-8c55-e913abb668bf tempest-CreateVolumesFromSourceVolumeTest-571511016 None] Lock "cinder-82fa47ed-c0fd-4056-a9e1-f08450885f32-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Flow 'volume_create_manager' (2ecd29c7-7292-4562-b37c-90fb66311bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e4d0b1-f2e0-4626-99c5-bd4f66ce7122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e4d0b1-f2e0-4626-99c5-bd4f66ce7122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1070e0-acfa-4e8a-82ae-d494132fe489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb206ef3d24991be31b73ac79a29fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:42Z,use_quota=True,user_id='5356f694812a42b5bb0af74fb40a6253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1de3a38-b856-4454-8ea4-e941fc62ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1de3a38-b856-4454-8ea4-e941fc62ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c23561-2ff3-4b2e-aedd-6048789820f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c23561-2ff3-4b2e-aedd-6048789820f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f1070e0-acfa-4e8a-82ae-d494132fe489', 'volume_name': 'volume-5f1070e0-acfa-4e8a-82ae-d494132fe489', 'volume_size': 1, 'image_id': 'cc78919d-c3c2-49ef-8e55-d870de8ced51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc78919d-c3c2-49ef-8e55-d870de8ced51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4200947f183d118af2dcac0b9e816b79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fdb206ef3d24991be31b73ac79a29fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd17ffb6b419bd4a56a4caa4b7e784208769874dc283b6f5e15c3a170ee2a0bf8f2363eae6675690f08878ba4b4bb2103eb772d902aa5024bf8bb5332951dfb5', 'id': 'cc78919d-c3c2-49ef-8e55-d870de8ced51', 'created_at': datetime.datetime(2026, 11, 6, 18, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc78919d-c3c2-49ef-8e55-d870de8ced51/file', 'properties': {}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6d6953-4145-45ea-bb8b-4afb0437cd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6d6953-4145-45ea-bb8b-4afb0437cd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:42 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe805ba3-8cc3-4592-bee7-6631e9c96f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:43 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Volume 5f1070e0-acfa-4e8a-82ae-d494132fe489: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f1070e0-acfa-4e8a-82ae-d494132fe489', 'volume_size': 1, 'image_id': 'cc78919d-c3c2-49ef-8e55-d870de8ced51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc78919d-c3c2-49ef-8e55-d870de8ced51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4200947f183d118af2dcac0b9e816b79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fdb206ef3d24991be31b73ac79a29fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd17ffb6b419bd4a56a4caa4b7e784208769874dc283b6f5e15c3a170ee2a0bf8f2363eae6675690f08878ba4b4bb2103eb772d902aa5024bf8bb5332951dfb5', 'id': 'cc78919d-c3c2-49ef-8e55-d870de8ced51', 'created_at': datetime.datetime(2026, 11, 6, 18, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc78919d-c3c2-49ef-8e55-d870de8ced51/file', 'properties': {}}, 'image_service': } Nov 06 19:48:43 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Trying to clone 5f1070e0-acfa-4e8a-82ae-d494132fe489 from image cc78919d-c3c2-49ef-8e55-d870de8ced51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc78919d-c3c2-49ef-8e55-d870de8ced51', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:48:43 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:48:43 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Image download 0.00 MB at 0.00 MB/s Nov 06 19:48:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[48677b87-f95c-42d7-b8c5-5a1f276f8c07]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:43 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD Nov 06 19:48:43 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:43 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:43 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD Nov 06 19:48:43 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:44 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Temporary image cc78919d-c3c2-49ef-8e55-d870de8ced51 is fetched for user 5356f694812a42b5bb0af74fb40a6253. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb53ec87-830c-4347-8a97-a7826e0bb619]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:44 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD Nov 06 19:48:44 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:44 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:44 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD Nov 06 19:48:44 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-c70d297f-f43f-4d67-9658-65d7fdb0d2f9 req-20694dd8-ec81-4268-8210-aa266bf42fa5 tempest-TestMinimumBasicScenario-353636532 None] Terminate volume connection completed successfully. Nov 06 19:48:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-c70d297f-f43f-4d67-9658-65d7fdb0d2f9 req-20694dd8-ec81-4268-8210-aa266bf42fa5 tempest-TestMinimumBasicScenario-353636532 None] Deleting attachment 399e256b-5237-4799-a353-0373cce27634. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:48:44 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1070e0-acfa-4e8a-82ae-d494132fe489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdb206ef3d24991be31b73ac79a29fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:42Z,use_quota=True,user_id='5356f694812a42b5bb0af74fb40a6253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Creating volume 5f1070e0-acfa-4e8a-82ae-d494132fe489 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:45 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:45 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 1073741824 Nov 06 19:48:45 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:45 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 1073741824" returned: 0 in 0.443s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:45 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 Nov 06 19:48:45 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Acquiring lock "cinder-480bd57c-3ca1-4fb3-b316-7a9be752e799-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Lock "cinder-480bd57c-3ca1-4fb3-b316-7a9be752e799-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Acquiring lock "cinder-quobyte-480bd57c-3ca1-4fb3-b316-7a9be752e799" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Lock "cinder-quobyte-480bd57c-3ca1-4fb3-b316-7a9be752e799" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:45 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489" returned: 0 in 0.304s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1290fee3-c183-40f5-b416-59d4cbe87312]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Attempting download of cc78919d-c3c2-49ef-8e55-d870de8ced51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc78919d-c3c2-49ef-8e55-d870de8ced51', 'metadata': {}}])) to volume 5f1070e0-acfa-4e8a-82ae-d494132fe489. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd0f553-7034-42d0-9122-7abd6b8f615b]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc78919d-c3c2-49ef-8e55-d870de8ced51_4pwf85be {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:45 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 Nov 06 19:48:45 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:46 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc78919d-c3c2-49ef-8e55-d870de8ced51_4pwf85be Nov 06 19:48:46 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:46 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:46 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:46 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799 Nov 06 19:48:46 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc78919d-c3c2-49ef-8e55-d870de8ced51_4pwf85be" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc78919d-c3c2-49ef-8e55-d870de8ced51_4pwf85be {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:46 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc78919d-c3c2-49ef-8e55-d870de8ced51_4pwf85be Nov 06 19:48:46 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:46 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-480bd57c-3ca1-4fb3-b316-7a9be752e799" returned: 0 in 0.259s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Lock "cinder-quobyte-480bd57c-3ca1-4fb3-b316-7a9be752e799" released by "delete_volume" :: held 0.681s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Created reservations ['496dae66-7494-40cb-b401-f4245e44e6de', '494843e5-48da-4be7-9b79-d37a4c9143c1', '51342509-e225-4994-9b32-e71451c51e9a', '2410ccbd-74ed-48f4-a20e-3dc643eda389'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:46 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc78919d-c3c2-49ef-8e55-d870de8ced51_4pwf85be" returned: 1 in 0.352s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc78919d-c3c2-49ef-8e55-d870de8ced51_4pwf85be' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a2350b-1542-4cea-9c98-03c066f9846b]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:46 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:46 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:46 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD Nov 06 19:48:46 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:46 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.303s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Deleted volume successfully. Nov 06 19:48:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-25e42f96-fda7-46ae-b3c8-42c027a38de4 tempest-TestMinimumBasicScenario-353636532 None] Lock "cinder-480bd57c-3ca1-4fb3-b316-7a9be752e799-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:47 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:47 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:47 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:47 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD Nov 06 19:48:47 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:47 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] cc78919d-c3c2-49ef-8e55-d870de8ced51 was raw, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:47 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.354s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:47 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 Nov 06 19:48:47 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:48:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:48:48 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489" returned: 0 in 0.654s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc78919d-c3c2-49ef-8e55-d870de8ced51_vi1bs9ckdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:48:48 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:48 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 1G Nov 06 19:48:48 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:48 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 1G" returned: 0 in 0.415s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Downloaded image cc78919d-c3c2-49ef-8e55-d870de8ced51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc78919d-c3c2-49ef-8e55-d870de8ced51', 'metadata': {}}])) to volume 5f1070e0-acfa-4e8a-82ae-d494132fe489 successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Temporary image cc78919d-c3c2-49ef-8e55-d870de8ced51 for user 5356f694812a42b5bb0af74fb40a6253 is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Marking volume 5f1070e0-acfa-4e8a-82ae-d494132fe489 as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Copying metadata from image cc78919d-c3c2-49ef-8e55-d870de8ced51 to 5f1070e0-acfa-4e8a-82ae-d494132fe489. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Creating volume glance metadata for volume 5f1070e0-acfa-4e8a-82ae-d494132fe489 backed by image cc78919d-c3c2-49ef-8e55-d870de8ced51 with: {'image_id': 'cc78919d-c3c2-49ef-8e55-d870de8ced51', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4200947f183d118af2dcac0b9e816b79', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe805ba3-8cc3-4592-bee7-6631e9c96f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1070e0-acfa-4e8a-82ae-d494132fe489', 'volume_size': 1, 'image_id': 'cc78919d-c3c2-49ef-8e55-d870de8ced51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc78919d-c3c2-49ef-8e55-d870de8ced51', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4200947f183d118af2dcac0b9e816b79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fdb206ef3d24991be31b73ac79a29fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd17ffb6b419bd4a56a4caa4b7e784208769874dc283b6f5e15c3a170ee2a0bf8f2363eae6675690f08878ba4b4bb2103eb772d902aa5024bf8bb5332951dfb5', 'id': 'cc78919d-c3c2-49ef-8e55-d870de8ced51', 'created_at': datetime.datetime(2026, 11, 6, 18, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 48, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc78919d-c3c2-49ef-8e55-d870de8ced51/file', 'properties': {}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080d4e87-ea30-4345-ab1c-2998be1a32a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:48 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Volume volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 (5f1070e0-acfa-4e8a-82ae-d494132fe489): created successfully Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080d4e87-ea30-4345-ab1c-2998be1a32a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Flow 'volume_create_manager' (2ecd29c7-7292-4562-b37c-90fb66311bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-42219348-fc57-4a8e-98dd-f1bd1a8aee8e tempest-VolumeImageDependencyTests-344860434 None] Created volume successfully. Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Acquiring lock "cinder-5f1070e0-acfa-4e8a-82ae-d494132fe489-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Lock "cinder-5f1070e0-acfa-4e8a-82ae-d494132fe489-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Acquiring lock "cinder-quobyte-5f1070e0-acfa-4e8a-82ae-d494132fe489" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Lock "cinder-quobyte-5f1070e0-acfa-4e8a-82ae-d494132fe489" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4630626-d4a5-47b1-a771-4900b7860d50]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:49 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 Nov 06 19:48:49 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:49 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489" returned: 0 in 0.388s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:49 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489 Nov 06 19:48:49 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:49 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f1070e0-acfa-4e8a-82ae-d494132fe489" returned: 0 in 0.264s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Lock "cinder-quobyte-5f1070e0-acfa-4e8a-82ae-d494132fe489" released by "delete_volume" :: held 0.706s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Created reservations ['0bdd9b5c-ac2f-4312-996b-a1ffb88588b8', '387843d5-1246-4ef5-bbdc-ab1a0340324e', '20295f3d-495c-4dbf-b600-a4c839948904', 'e54cf88a-5ee7-4a07-9ed7-85fec8d73f64'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:50 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:48:50 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:50 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.286s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:50 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:48:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Deleted volume successfully. Nov 06 19:48:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6cb8964e-f6e5-441a-b59f-5d4188b57887 tempest-VolumeImageDependencyTests-344860434 None] Lock "cinder-5f1070e0-acfa-4e8a-82ae-d494132fe489-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=175,cinder:SELECT=119,cinder:INSERT=42,cinder:DELETE=15 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=135,cinder:UPDATE=158,cinder:DELETE=15,cinder:INSERT=43 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Flow 'volume_create_manager' (f809297e-dcb6-43c7-9ea4-6205e5e12e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00430039-3765-4130-9c7e-5c028feaf701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00430039-3765-4130-9c7e-5c028feaf701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12f862a-eac2-4b20-8806-802ca0c4f211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3863e15c544fbfb3f8fcefafa1a4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:53Z,use_quota=True,user_id='e0fb8897ca644a0abcee251abcd67cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c34df6a-18f4-438e-94b4-99f7e4bc1a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c34df6a-18f4-438e-94b4-99f7e4bc1a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83825a41-1137-4f40-9017-e219bd8a4928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83825a41-1137-4f40-9017-e219bd8a4928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12f862a-eac2-4b20-8806-802ca0c4f211', 'volume_name': 'volume-f12f862a-eac2-4b20-8806-802ca0c4f211', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876ec429-d430-4775-a458-dd64af476b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876ec429-d430-4775-a458-dd64af476b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea97c668-eab1-4cf9-ac22-51561fdc463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Volume f12f862a-eac2-4b20-8806-802ca0c4f211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12f862a-eac2-4b20-8806-802ca0c4f211', 'volume_size': 1} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12f862a-eac2-4b20-8806-802ca0c4f211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3863e15c544fbfb3f8fcefafa1a4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:53Z,use_quota=True,user_id='e0fb8897ca644a0abcee251abcd67cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Creating volume f12f862a-eac2-4b20-8806-802ca0c4f211 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:53 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:53 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 1073741824 Nov 06 19:48:53 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:54 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 1073741824" returned: 0 in 0.447s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:54 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 Nov 06 19:48:54 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:54 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211" returned: 0 in 0.304s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea97c668-eab1-4cf9-ac22-51561fdc463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12f862a-eac2-4b20-8806-802ca0c4f211', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76aa45e-a204-4903-b26b-64d9cfb54619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:54 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Volume volume-f12f862a-eac2-4b20-8806-802ca0c4f211 (f12f862a-eac2-4b20-8806-802ca0c4f211): created successfully Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76aa45e-a204-4903-b26b-64d9cfb54619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Flow 'volume_create_manager' (f809297e-dcb6-43c7-9ea4-6205e5e12e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-61cfbace-e2bc-4dd0-ac3a-03a687f1e648 tempest-CinderUnicodeTest-461004698 None] Created volume successfully. Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Flow 'volume_create_manager' (dfa83565-6a97-47f6-876e-097d321a2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9937a7bc-5072-464e-92f8-aa40755a818a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9937a7bc-5072-464e-92f8-aa40755a818a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1328103793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cc1400-faac-4de8-aefd-8bf45a9cd94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3863e15c544fbfb3f8fcefafa1a4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:56Z,use_quota=True,user_id='e0fb8897ca644a0abcee251abcd67cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff08217c-a0c1-46eb-a415-16677474d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff08217c-a0c1-46eb-a415-16677474d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c370701c-2fee-44a9-9a79-e42d1ec226f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c370701c-2fee-44a9-9a79-e42d1ec226f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cc1400-faac-4de8-aefd-8bf45a9cd94f', 'volume_name': 'volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5ab167-a23c-4b17-93f2-ae7d0ffd58a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5ab167-a23c-4b17-93f2-ae7d0ffd58a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6365f3a2-eb53-49cc-a97a-76db43416e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:56 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Volume 53cc1400-faac-4de8-aefd-8bf45a9cd94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f', 'volume_size': 1} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:48:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1328103793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cc1400-faac-4de8-aefd-8bf45a9cd94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3863e15c544fbfb3f8fcefafa1a4ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:48:56Z,use_quota=True,user_id='e0fb8897ca644a0abcee251abcd67cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Creating volume 53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:48:56 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:56 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f 1073741824 Nov 06 19:48:56 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:56 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f 1073741824" returned: 0 in 0.435s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:56 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f Nov 06 19:48:56 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:56 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6365f3a2-eb53-49cc-a97a-76db43416e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112ec55d-9534-4d25-8f6b-1b1ad4a6d831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:48:56 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Volume volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f (53cc1400-faac-4de8-aefd-8bf45a9cd94f): created successfully Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112ec55d-9534-4d25-8f6b-1b1ad4a6d831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:48:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Flow 'volume_create_manager' (dfa83565-6a97-47f6-876e-097d321a2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:48:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c7f47f55-1d01-44e3-a649-58e3308d5643 tempest-CinderUnicodeTest-461004698 None] Created volume successfully. Nov 06 19:48:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:48:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:48:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Creating offline snapshot 2cf576f3-9375-40f0-81ac-8c7ffdce2d2f of volume 53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:48:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc6307b-9745-4cf1-b404-002701428ab3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:48:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:57 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f Nov 06 19:48:57 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:57 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f" returned: 0 in 0.425s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:57 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f 1G Nov 06 19:48:57 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:58 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f 1G" returned: 0 in 0.492s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:58 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f Nov 06 19:48:58 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:58 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" returned: 0 in 0.367s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:58 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f is being set with open permissions: ugo+rw Nov 06 19:48:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:58 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f Nov 06 19:48:58 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:58 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:59 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.info Nov 06 19:48:59 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:59 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.info" returned: 0 in 0.305s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:59 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.info is being set with open permissions: ugo+rw Nov 06 19:48:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:48:59 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.info Nov 06 19:48:59 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:48:59 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 06 19:48:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.info" returned: 0 in 0.313s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:48:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:48:59 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9be3154d-217b-410f-8983-d6e7c5d826ec tempest-CinderUnicodeTest-461004698 None] Create snapshot completed successfully Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "cinder-2cf576f3-9375-40f0-81ac-8c7ffdce2d2f-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-2cf576f3-9375-40f0-81ac-8c7ffdce2d2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "cinder-quobyte-53cc1400-faac-4de8-aefd-8bf45a9cd94f" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-53cc1400-faac-4de8-aefd-8bf45a9cd94f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "cinder-quobyte-2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Deleting offline snapshot 2cf576f3-9375-40f0-81ac-8c7ffdce2d2f of volume 53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] snapshot_file for this snap is: volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc87196-5860-44fe-a4e2-eb3aeb895c88]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:00 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f Nov 06 19:49:00 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:00 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" returned: 0 in 0.387s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[881cef9f-c10e-4959-b2a4-396793c9f24e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:01 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f Nov 06 19:49:01 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:01 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f" returned: 0 in 0.367s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:01 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f Nov 06 19:49:01 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:01 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" returned: 0 in 0.363s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:01 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f Nov 06 19:49:01 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:02 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f.2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" returned: 0 in 0.290s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-2cf576f3-9375-40f0-81ac-8c7ffdce2d2f" released by "_delete_snapshot" :: held 1.530s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-53cc1400-faac-4de8-aefd-8bf45a9cd94f" released by "delete_snapshot" :: held 1.560s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Created reservations ['20dfac97-9632-466a-8d34-5c216d1f9e96', 'e6330c48-ea6d-45af-9b59-f3a9cea64311', '537de85e-23d8-4bb7-b525-9b1886438e8f', '614b3036-9e14-4c37-b05c-54d6ae037146'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:49:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Delete snapshot completed successfully. Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b43e13af-9a56-4f97-bdd0-965843f6f924 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-2cf576f3-9375-40f0-81ac-8c7ffdce2d2f-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Acquiring lock "cinder-53cc1400-faac-4de8-aefd-8bf45a9cd94f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Lock "cinder-53cc1400-faac-4de8-aefd-8bf45a9cd94f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Acquiring lock "cinder-quobyte-53cc1400-faac-4de8-aefd-8bf45a9cd94f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-53cc1400-faac-4de8-aefd-8bf45a9cd94f" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9f94cd-3ac4-4828-91ce-a668946d58a6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:02 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f Nov 06 19:49:02 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-db574d29-a57b-4bb3-b82f-2a1e1604fd9f req-421cfb4b-f573-4165-9bc4-7e97c9a3fc87 tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-db574d29-a57b-4bb3-b82f-2a1e1604fd9f req-421cfb4b-f573-4165-9bc4-7e97c9a3fc87 tempest-TestStampPattern-1152151569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-db574d29-a57b-4bb3-b82f-2a1e1604fd9f req-421cfb4b-f573-4165-9bc4-7e97c9a3fc87 tempest-TestStampPattern-1152151569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-db574d29-a57b-4bb3-b82f-2a1e1604fd9f req-421cfb4b-f573-4165-9bc4-7e97c9a3fc87 tempest-TestStampPattern-1152151569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26cf7132-1f84-4aa6-83ae-2fe92291c918', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:49:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-db574d29-a57b-4bb3-b82f-2a1e1604fd9f req-421cfb4b-f573-4165-9bc4-7e97c9a3fc87 tempest-TestStampPattern-1152151569 None] attachment_update completed successfully. Nov 06 19:49:03 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:03 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f Nov 06 19:49:03 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:03 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-53cc1400-faac-4de8-aefd-8bf45a9cd94f" returned: 0 in 0.333s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-53cc1400-faac-4de8-aefd-8bf45a9cd94f" released by "delete_volume" :: held 0.851s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Created reservations ['a4b6f448-c102-489f-ae86-a5e0b30e8d49', 'aeeabfff-9008-4dfe-85f1-ca59cbf6b273', 'bf3c597b-cfc0-4fce-a9cd-a9581f8040fe', '8d929e3c-8247-467e-96b3-6d2aefa5b117'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:03 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:49:03 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "cinder-f12f862a-eac2-4b20-8806-802ca0c4f211-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-f12f862a-eac2-4b20-8806-802ca0c4f211-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "cinder-quobyte-f12f862a-eac2-4b20-8806-802ca0c4f211" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-f12f862a-eac2-4b20-8806-802ca0c4f211" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61fe68-2861-4965-9157-1e2924096901]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:04 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.428s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:49:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Deleted volume successfully. Nov 06 19:49:04 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 Nov 06 19:49:04 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2d8e2d5c-8417-49af-9774-67969cf2b68a tempest-CinderUnicodeTest-461004698 None] Lock "cinder-53cc1400-faac-4de8-aefd-8bf45a9cd94f-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:04 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211" returned: 0 in 0.454s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:04 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211 Nov 06 19:49:04 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:04 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f12f862a-eac2-4b20-8806-802ca0c4f211" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-quobyte-f12f862a-eac2-4b20-8806-802ca0c4f211" released by "delete_volume" :: held 0.787s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Created reservations ['bbc7e4c4-7936-405e-88e4-d843db22b5f3', 'a40bec58-53f3-4e18-8474-d8b24952ae45', 'dc9e003f-1755-4071-8d38-115ebd5bf904', 'ea7e18f8-bc1e-4382-97a1-e471bb0cd010'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:05 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:49:05 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:05 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.323s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:05 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:49:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Deleted volume successfully. Nov 06 19:49:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-785cebe5-658e-40e7-9c5b-56ea7b37f8c9 tempest-CinderUnicodeTest-461004698 None] Lock "cinder-f12f862a-eac2-4b20-8806-802ca0c4f211-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-14689b39-8c7c-4fc1-a66f-0d5fd3a093ad req-811b1fd8-b3c7-48f4-9b6a-c175b517b1d2 tempest-TestStampPattern-1152151569 None] Terminate volume connection completed successfully. Nov 06 19:49:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-14689b39-8c7c-4fc1-a66f-0d5fd3a093ad req-811b1fd8-b3c7-48f4-9b6a-c175b517b1d2 tempest-TestStampPattern-1152151569 None] Deleting attachment 26cf7132-1f84-4aa6-83ae-2fe92291c918. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Lock "cinder-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-quobyte-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[212f9989-ef36-4402-a655-241af9b35892]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:14 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 Nov 06 19:49:14 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:14 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" returned: 0 in 0.385s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:14 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6 Nov 06 19:49:14 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:15 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" returned: 0 in 0.274s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6" released by "delete_volume" :: held 0.726s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Created reservations ['14306c6a-e145-4ef1-97f2-c13bde8e1236', '090502cc-169d-4146-b0ab-52ef22299351', '2812fe1f-a3b5-40eb-aae6-a387cdf78c8b', '295c54d8-9d55-49e3-b3e5-250405e238ef'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:15 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:49:15 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:15 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.280s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:49:15 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Deleted volume successfully. Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0870170d-3a4e-47fb-93b8-9912caff532c tempest-TestStampPattern-1152151569 None] Lock "cinder-cc984287-e0e9-4f8c-8d84-0bedcb4a7bd6-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-5f57c82b-a78a-4f2e-998b-13720077e559-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Lock "cinder-5f57c82b-a78a-4f2e-998b-13720077e559-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-quobyte-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-quobyte-5f57c82b-a78a-4f2e-998b-13720077e559" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-5f57c82b-a78a-4f2e-998b-13720077e559" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Deleting offline snapshot 5f57c82b-a78a-4f2e-998b-13720077e559 of volume 9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] snapshot_file for this snap is: volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5354b91-d5c3-4374-8279-96c4575254b8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:16 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 Nov 06 19:49:16 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:16 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559" returned: 0 in 0.370s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:49:16 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c9760-031d-4a9d-95bc-7fcfbb517a6e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:16 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 Nov 06 19:49:16 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:16 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" returned: 0 in 0.556s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:16 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 Nov 06 19:49:16 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:17 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559" returned: 0 in 0.334s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:17 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559 Nov 06 19:49:17 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:17 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10.5f57c82b-a78a-4f2e-998b-13720077e559" returned: 0 in 0.259s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-5f57c82b-a78a-4f2e-998b-13720077e559" released by "_delete_snapshot" :: held 1.648s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" released by "delete_snapshot" :: held 1.675s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:17 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Created reservations ['a8465874-72d5-4c7c-9517-1a94c3cc0486', '077a26d5-08aa-4c94-aec1-0ee29babbc86', '35d2af31-f49e-4352-901a-0602909fd8ab', 'da5b7cd7-6d73-42c0-884b-8c5c63d1c314'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:49:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Delete snapshot completed successfully. Nov 06 19:49:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cc0d8254-42c2-4573-bf1c-ff759212b8e8 tempest-TestStampPattern-1152151569 None] Lock "cinder-5f57c82b-a78a-4f2e-998b-13720077e559-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-9e95b4d9-d6d0-4ce7-8796-8944809cdf10-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Lock "cinder-9e95b4d9-d6d0-4ce7-8796-8944809cdf10-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Acquiring lock "cinder-quobyte-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be3fda1-ad78-42d4-9ad4-b84d3b004e93]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:23 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 Nov 06 19:49:23 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Flow 'volume_create_manager' (4c7a8bc9-76cb-40e6-b052-a2366784c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d94bb2-5486-49ff-b897-c0c0c788b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d94bb2-5486-49ff-b897-c0c0c788b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1830655602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383d6943-d5fa-4f3a-8657-fb6d47071200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6589a4a1fcc43019896e8a42b20e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:49:24Z,use_quota=True,user_id='d40b64de5d454cb6b86f43f8a47ff5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc79385-725d-48f0-94bb-21980a44f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc79385-725d-48f0-94bb-21980a44f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3db84a-55ad-41ad-bf52-4e516ac3a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:23 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3db84a-55ad-41ad-bf52-4e516ac3a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383d6943-d5fa-4f3a-8657-fb6d47071200', 'volume_name': 'volume-383d6943-d5fa-4f3a-8657-fb6d47071200', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ab50fc-28d0-4f17-a31a-e0483f4db452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ab50fc-28d0-4f17-a31a-e0483f4db452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42542959-1a3c-4bc9-89d9-11a8925b4277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:23 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Volume 383d6943-d5fa-4f3a-8657-fb6d47071200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383d6943-d5fa-4f3a-8657-fb6d47071200', 'volume_size': 1} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1830655602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383d6943-d5fa-4f3a-8657-fb6d47071200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6589a4a1fcc43019896e8a42b20e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:49:24Z,use_quota=True,user_id='d40b64de5d454cb6b86f43f8a47ff5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Creating volume 383d6943-d5fa-4f3a-8657-fb6d47071200 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:49:23 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" returned: 0 in 0.424s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:24 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 1073741824 Nov 06 19:49:24 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:24 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10 Nov 06 19:49:24 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Flow 'volume_create_manager' (c3383d12-024a-4e1d-91f4-d6fdf5f62f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7803d332-dc36-4cfb-b1fd-bd4fc1c0ca18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7803d332-dc36-4cfb-b1fd-bd4fc1c0ca18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1004234332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fcee9b-7683-4d14-9e76-c1a5e20f4d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6589a4a1fcc43019896e8a42b20e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:49:24Z,use_quota=True,user_id='d40b64de5d454cb6b86f43f8a47ff5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66f7e12-c965-4786-af19-7eabe803779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66f7e12-c965-4786-af19-7eabe803779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1682701e-30b0-462f-92f2-7a90ba95cbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:24 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1682701e-30b0-462f-92f2-7a90ba95cbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fcee9b-7683-4d14-9e76-c1a5e20f4d94', 'volume_name': 'volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b33243-99c4-4fbb-bcc1-3d9826caba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b33243-99c4-4fbb-bcc1-3d9826caba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f8df10-b055-4369-8f1b-8cdf03c62117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:24 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Volume a4fcee9b-7683-4d14-9e76-c1a5e20f4d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94', 'volume_size': 1} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" returned: 0 in 0.352s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Lock "cinder-quobyte-9e95b4d9-d6d0-4ce7-8796-8944809cdf10" released by "delete_volume" :: held 0.861s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Created reservations ['472c7bbc-f0fc-41c8-a1b5-e782d8cb056d', 'c6f40f0f-fa21-41b4-ae65-9b68fb293724', 'c73c8f5d-4aa1-425a-aa22-d5a5176fb0df', '08c8e686-3741-4829-a1d0-9d0980edd727'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:49:24 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 1073741824" returned: 0 in 0.517s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:24 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:49:24 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:24 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 Nov 06 19:49:24 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:24 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.305s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:49:24 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Deleted volume successfully. Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c7321f67-d86a-4291-896f-3ae47d7a0802 tempest-TestStampPattern-1152151569 None] Lock "cinder-9e95b4d9-d6d0-4ce7-8796-8944809cdf10-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:49:24 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200" returned: 0 in 0.373s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1004234332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fcee9b-7683-4d14-9e76-c1a5e20f4d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6589a4a1fcc43019896e8a42b20e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:49:24Z,use_quota=True,user_id='d40b64de5d454cb6b86f43f8a47ff5f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Creating volume a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:49:24 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42542959-1a3c-4bc9-89d9-11a8925b4277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383d6943-d5fa-4f3a-8657-fb6d47071200', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9b3d0a-227a-4f3c-83d3-d23c243e1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:24 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 1073741824 Nov 06 19:49:24 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Volume volume-383d6943-d5fa-4f3a-8657-fb6d47071200 (383d6943-d5fa-4f3a-8657-fb6d47071200): created successfully Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9b3d0a-227a-4f3c-83d3-d23c243e1eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Flow 'volume_create_manager' (4c7a8bc9-76cb-40e6-b052-a2366784c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:49:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-045ab47f-0935-479d-8793-ba0a4b7c8ce5 tempest-TestServerVolumeAttachmentScenario-235808684 None] Created volume successfully. Nov 06 19:49:25 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 1073741824" returned: 0 in 0.553s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:25 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 Nov 06 19:49:25 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:25 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f8df10-b055-4369-8f1b-8cdf03c62117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84df8692-dd80-46c4-b2b2-cecea8a3384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:49:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Volume volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 (a4fcee9b-7683-4d14-9e76-c1a5e20f4d94): created successfully Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84df8692-dd80-46c4-b2b2-cecea8a3384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:49:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Flow 'volume_create_manager' (c3383d12-024a-4e1d-91f4-d6fdf5f62f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:49:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-dceac04e-9c5b-44cb-b245-80aab98bf494 tempest-TestServerVolumeAttachmentScenario-235808684 None] Created volume successfully. Nov 06 19:49:35 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=7,cinder:SELECT=45 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:49:35 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=54,cinder:UPDATE=57,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:49:47 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:49:47 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:49:47 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.233s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:49:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:49:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ca05966a-1bcf-4e1b-8195-9f520275207c req-de39b67b-22cb-47af-af2c-87e391704f94 tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ca05966a-1bcf-4e1b-8195-9f520275207c req-de39b67b-22cb-47af-af2c-87e391704f94 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-ca05966a-1bcf-4e1b-8195-9f520275207c req-de39b67b-22cb-47af-af2c-87e391704f94 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-ca05966a-1bcf-4e1b-8195-9f520275207c req-de39b67b-22cb-47af-af2c-87e391704f94 tempest-TestServerVolumeAttachmentScenario-235808684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-383d6943-d5fa-4f3a-8657-fb6d47071200', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b082acf-f239-46e5-bba7-1a273150850e', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:49:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-ca05966a-1bcf-4e1b-8195-9f520275207c req-de39b67b-22cb-47af-af2c-87e391704f94 tempest-TestServerVolumeAttachmentScenario-235808684 None] attachment_update completed successfully. Nov 06 19:49:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-32555b3a-6580-4dec-ad31-f829eaaed26d req-57cce1c2-ae26-4085-bb87-be302a3b3737 tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:49:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-32555b3a-6580-4dec-ad31-f829eaaed26d req-57cce1c2-ae26-4085-bb87-be302a3b3737 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:49:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-32555b3a-6580-4dec-ad31-f829eaaed26d req-57cce1c2-ae26-4085-bb87-be302a3b3737 tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:49:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-32555b3a-6580-4dec-ad31-f829eaaed26d req-57cce1c2-ae26-4085-bb87-be302a3b3737 tempest-TestServerVolumeAttachmentScenario-235808684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '602c233c-7e26-4337-8d0a-deed725dfae4', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:49:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-32555b3a-6580-4dec-ad31-f829eaaed26d req-57cce1c2-ae26-4085-bb87-be302a3b3737 tempest-TestServerVolumeAttachmentScenario-235808684 None] attachment_update completed successfully. Nov 06 19:50:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-c96980ad-0bc9-40d0-86b9-1ed1c58d5f98 req-64ab5921-0df6-46e0-a6ba-92c24e818659 tempest-TestServerVolumeAttachmentScenario-235808684 None] Terminate volume connection completed successfully. Nov 06 19:50:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-c96980ad-0bc9-40d0-86b9-1ed1c58d5f98 req-64ab5921-0df6-46e0-a6ba-92c24e818659 tempest-TestServerVolumeAttachmentScenario-235808684 None] Deleting attachment 602c233c-7e26-4337-8d0a-deed725dfae4. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:50:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-b5b7197e-b346-4e59-a74c-077a5a406788 req-bfd26acb-ad84-4262-a226-d69e8c555a6f tempest-TestServerVolumeAttachmentScenario-235808684 None] Terminate volume connection completed successfully. Nov 06 19:50:01 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-b5b7197e-b346-4e59-a74c-077a5a406788 req-bfd26acb-ad84-4262-a226-d69e8c555a6f tempest-TestServerVolumeAttachmentScenario-235808684 None] Deleting attachment 9b082acf-f239-46e5-bba7-1a273150850e. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "cinder-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "cinder-quobyte-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-quobyte-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1280914-53d3-491b-9a7e-35b4f1d88c33]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:06 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 Nov 06 19:50:06 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:06 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94" returned: 0 in 0.366s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:06 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94 Nov 06 19:50:06 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:06 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94" returned: 0 in 0.240s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-quobyte-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94" released by "delete_volume" :: held 0.645s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Created reservations ['b404ff1f-4184-44ab-a65b-1923fc51c439', '424787e1-eea8-4e5f-886d-556e2eb88ac4', '3e56d12c-54d4-4663-b27f-4f92d416c847', '2b90648a-6902-4e4a-b792-e2382e87f59a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:50:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:07 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:50:07 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:07 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:50:07 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Deleted volume successfully. Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8ad29038-66a2-4058-879f-ea32c6740ddf tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-a4fcee9b-7683-4d14-9e76-c1a5e20f4d94-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "cinder-383d6943-d5fa-4f3a-8657-fb6d47071200-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-383d6943-d5fa-4f3a-8657-fb6d47071200-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "cinder-quobyte-383d6943-d5fa-4f3a-8657-fb6d47071200" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-quobyte-383d6943-d5fa-4f3a-8657-fb6d47071200" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7620ab-0815-4b9f-983d-d1108d0c693f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:07 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 Nov 06 19:50:07 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:07 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200" returned: 0 in 0.352s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:07 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200 Nov 06 19:50:07 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:08 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-383d6943-d5fa-4f3a-8657-fb6d47071200" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-quobyte-383d6943-d5fa-4f3a-8657-fb6d47071200" released by "delete_volume" :: held 0.663s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Created reservations ['e09adf65-9729-426a-80df-3f2727dcb420', 'f7837d7b-406f-4656-a6b8-756cf28bf6a2', 'd7f86e09-d322-418b-9b39-c0a17862fc2b', '7ab8d27d-f51d-4544-aef3-a49badd3ffb0'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:08 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:50:08 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:08 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.251s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:50:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Deleted volume successfully. Nov 06 19:50:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9e80d5e3-88f0-43c5-9d80-5b6e7414359d tempest-TestServerVolumeAttachmentScenario-235808684 None] Lock "cinder-383d6943-d5fa-4f3a-8657-fb6d47071200-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:50:18 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:50:18 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Flow 'volume_create_manager' (5a5627f1-d0c9-4a82-aa6b-431d365e504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a646cb97-e9bd-499a-8d2c-cfecb2cd340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a646cb97-e9bd-499a-8d2c-cfecb2cd340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-186319172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2255815e-b078-4027-baa5-3ebda270c806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d182cff0aeb24fda9242ba611cb1a197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:50:40Z,use_quota=True,user_id='d85048bdd50b4f8780ab1e6dc5813564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5bed0d-be73-4e7d-bd5b-341f04c191da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5bed0d-be73-4e7d-bd5b-341f04c191da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26ff711-3e3e-426a-baa3-09e8d68b9204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26ff711-3e3e-426a-baa3-09e8d68b9204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2255815e-b078-4027-baa5-3ebda270c806', 'volume_name': 'volume-2255815e-b078-4027-baa5-3ebda270c806', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba9cfc7-bda7-4e6c-b304-b4e804aa609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba9cfc7-bda7-4e6c-b304-b4e804aa609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cc8bc3-a2ec-4f42-9cb9-e605054fe115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:50:40 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Volume 2255815e-b078-4027-baa5-3ebda270c806: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2255815e-b078-4027-baa5-3ebda270c806', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Trying to clone 2255815e-b078-4027-baa5-3ebda270c806 from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:50:40 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Image download 20.69 MB at 20.69 MB/s Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d14bf0c-2f6e-4aee-8e8b-ccadcabd53b6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:50:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:41 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD Nov 06 19:50:41 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:41 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 is fetched for user d85048bdd50b4f8780ab1e6dc5813564. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08ab80-d614-4349-bac6-4c7504d8e562]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:41 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD Nov 06 19:50:41 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:41 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-186319172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2255815e-b078-4027-baa5-3ebda270c806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d182cff0aeb24fda9242ba611cb1a197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:50:40Z,use_quota=True,user_id='d85048bdd50b4f8780ab1e6dc5813564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Creating volume 2255815e-b078-4027-baa5-3ebda270c806 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:50:41 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:50:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:41 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 1073741824 Nov 06 19:50:41 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:42 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 1073741824" returned: 0 in 0.408s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:42 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 Nov 06 19:50:42 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:42 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806" returned: 0 in 0.250s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Attempting download of 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume 2255815e-b078-4027-baa5-3ebda270c806. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84ff60f-779d-4e1b-b2d4-5c1e8455079c]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_u1gn2a3n {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:42 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_u1gn2a3n Nov 06 19:50:42 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:42 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_u1gn2a3n" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_u1gn2a3n {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:42 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_u1gn2a3n Nov 06 19:50:42 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:43 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_u1gn2a3n" returned: 1 in 0.322s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ceb92fc-a0e0-406c-96f4-c36f37d42275_u1gn2a3n' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:50:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c2e34-d14d-4c1c-a7d1-f43b071ccc2a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:50:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:43 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD Nov 06 19:50:43 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:43 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:43 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] 1ceb92fc-a0e0-406c-96f4-c36f37d42275 was qcow2, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:50:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:43 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 Nov 06 19:50:43 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:45 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806" returned: 0 in 1.669s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ceb92fc-a0e0-406c-96f4-c36f37d42275_uggb3phjdevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:50:45 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Converted 112.00 MB image at 67.07 MB/s Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:45 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 1G Nov 06 19:50:45 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:45 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 1G" returned: 0 in 0.314s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Downloaded image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}])) to volume 2255815e-b078-4027-baa5-3ebda270c806 successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Temporary image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 for user d85048bdd50b4f8780ab1e6dc5813564 is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Marking volume 2255815e-b078-4027-baa5-3ebda270c806 as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Copying metadata from image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 to 2255815e-b078-4027-baa5-3ebda270c806. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Creating volume glance metadata for volume 2255815e-b078-4027-baa5-3ebda270c806 backed by image 1ceb92fc-a0e0-406c-96f4-c36f37d42275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cc8bc3-a2ec-4f42-9cb9-e605054fe115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2255815e-b078-4027-baa5-3ebda270c806', 'volume_size': 1, 'image_id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc53e943248e4552b68ba96a03b5ff79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ceb92fc-a0e0-406c-96f4-c36f37d42275', 'created_at': datetime.datetime(2026, 11, 6, 18, 28, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 28, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ceb92fc-a0e0-406c-96f4-c36f37d42275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db65a16-332d-45f5-b2cc-3acce87d2e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:50:45 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Volume volume-2255815e-b078-4027-baa5-3ebda270c806 (2255815e-b078-4027-baa5-3ebda270c806): created successfully Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db65a16-332d-45f5-b2cc-3acce87d2e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:50:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Flow 'volume_create_manager' (5a5627f1-d0c9-4a82-aa6b-431d365e504b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:50:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c150d290-3d72-4a27-be3b-1c5bd686fc49 tempest-TestShelveInstance-889943427 None] Created volume successfully. Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:50:47 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:50:47 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:50:47 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.274s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:50:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:50:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-c3445ec7-11b7-4742-8dc4-59d6d400b8d8 req-39c6f1d6-bec6-4ba1-858c-8b9f9b972402 tempest-TestShelveInstance-889943427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:50:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-c3445ec7-11b7-4742-8dc4-59d6d400b8d8 req-39c6f1d6-bec6-4ba1-858c-8b9f9b972402 tempest-TestShelveInstance-889943427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:50:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-c3445ec7-11b7-4742-8dc4-59d6d400b8d8 req-39c6f1d6-bec6-4ba1-858c-8b9f9b972402 tempest-TestShelveInstance-889943427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:50:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-c3445ec7-11b7-4742-8dc4-59d6d400b8d8 req-39c6f1d6-bec6-4ba1-858c-8b9f9b972402 tempest-TestShelveInstance-889943427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-2255815e-b078-4027-baa5-3ebda270c806', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4f5336c-d120-4e6e-ad4a-af92cf83264b', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:50:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-c3445ec7-11b7-4742-8dc4-59d6d400b8d8 req-39c6f1d6-bec6-4ba1-858c-8b9f9b972402 tempest-TestShelveInstance-889943427 None] attachment_update completed successfully. Nov 06 19:50:58 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4,cinder:INSERT=7 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:50:58 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:51:20 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-834df225-3f7c-4ea3-b76d-7d992928c173 req-92b7d42a-c59a-4948-905c-129c19fa66e2 tempest-TestShelveInstance-889943427 None] Terminate volume connection completed successfully. Nov 06 19:51:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-834df225-3f7c-4ea3-b76d-7d992928c173 req-92b7d42a-c59a-4948-905c-129c19fa66e2 tempest-TestShelveInstance-889943427 None] Deleting attachment f4f5336c-d120-4e6e-ad4a-af92cf83264b. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:51:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3ba11c4a-4d70-4af9-9d91-4fa5d9fcbb77 req-14efd533-1d6c-4f6e-93aa-1dc47f162835 tempest-TestShelveInstance-889943427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:51:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3ba11c4a-4d70-4af9-9d91-4fa5d9fcbb77 req-14efd533-1d6c-4f6e-93aa-1dc47f162835 tempest-TestShelveInstance-889943427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:51:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-3ba11c4a-4d70-4af9-9d91-4fa5d9fcbb77 req-14efd533-1d6c-4f6e-93aa-1dc47f162835 tempest-TestShelveInstance-889943427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:51:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-3ba11c4a-4d70-4af9-9d91-4fa5d9fcbb77 req-14efd533-1d6c-4f6e-93aa-1dc47f162835 tempest-TestShelveInstance-889943427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6', 'name': 'volume-2255815e-b078-4027-baa5-3ebda270c806', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9708993d-bf4c-4536-bcc0-62b7071b5ec7', 'enforce_multipath': True} {{(pid=86928) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 19:51:23 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-3ba11c4a-4d70-4af9-9d91-4fa5d9fcbb77 req-14efd533-1d6c-4f6e-93aa-1dc47f162835 tempest-TestShelveInstance-889943427 None] attachment_update completed successfully. Nov 06 19:51:33 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:51:33 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:51:47 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:51:47 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:51:47 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:51:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:51:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-afe8ce91-108d-4bea-b388-928abb913e0f tempest-TestShelveInstance-889943427 None] Terminate volume connection completed successfully. Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-afe8ce91-108d-4bea-b388-928abb913e0f tempest-TestShelveInstance-889943427 None] Deleting attachment 9708993d-bf4c-4536-bcc0-62b7071b5ec7. {{(pid=86928) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Acquiring lock "cinder-2255815e-b078-4027-baa5-3ebda270c806-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Lock "cinder-2255815e-b078-4027-baa5-3ebda270c806-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Acquiring lock "cinder-quobyte-2255815e-b078-4027-baa5-3ebda270c806" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Lock "cinder-quobyte-2255815e-b078-4027-baa5-3ebda270c806" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[88043a0e-1817-4cc7-b963-5b8667ef8240]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:51:50 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 Nov 06 19:51:50 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:51:50 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:51:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:51:50 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806 Nov 06 19:51:50 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:51:51 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2255815e-b078-4027-baa5-3ebda270c806" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Lock "cinder-quobyte-2255815e-b078-4027-baa5-3ebda270c806" released by "delete_volume" :: held 0.701s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG cinder.quota [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Created reservations ['a997693e-6fbe-4027-adff-20dde740e086', '9700c7b7-f049-4bc7-9b76-a477c3512e9b', 'f46a1a5b-6774-42ea-8c41-70fef32c28ef', 'cd67c721-cef0-4df1-8b58-3dd2f7a17263'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:51:51 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:51:51 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:51:51 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.240s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG cinder.manager [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:51:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Deleted volume successfully. Nov 06 19:51:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [req-c3fbcfe8-6869-48be-b3ed-2ad299db6527 req-3717b7df-f017-49aa-b421-2ca08729d7d7 tempest-TestShelveInstance-889943427 None] Lock "cinder-2255815e-b078-4027-baa5-3ebda270c806-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:01 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:52:01 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Flow 'volume_create_manager' (31fc7182-7bb6-4cbc-ac5a-deb299c6799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a8525-99fe-477b-92b1-223b01743e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005a8525-99fe-477b-92b1-223b01743e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3715d67e-43c6-42c6-be10-7271d9d9e9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2475da5e370549e2b4e8f2cec921e620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:06Z,use_quota=True,user_id='adf1d97fefc14e0eb49425d14904d9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c9b4252-311d-4d1e-b3af-2b819f9a32f4),volume_type_id=4c9b4252-311d-4d1e-b3af-2b819f9a32f4)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811b4e48-d6bc-4a0f-af68-79652f7d7999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811b4e48-d6bc-4a0f-af68-79652f7d7999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb080fa-6759-4780-a41a-634f670c3623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb080fa-6759-4780-a41a-634f670c3623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3715d67e-43c6-42c6-be10-7271d9d9e9a2', 'volume_name': 'volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2', 'volume_size': 1, 'image_id': 'd64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe4a406c6c72d4cea6d78b5861844fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2475da5e370549e2b4e8f2cec921e620', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fca1881a11f81d7a05a8566522f51ca41445789b0d202bd7793c6cb10bae5b6ef6ea0abfdd1a9a1f2fc265cd1d6afe43c01eeef2c941be0a8eb9dec5c324ee74', 'id': 'd64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'created_at': datetime.datetime(2026, 11, 6, 18, 52, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 52, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39825d6f-5d95-4b1d-84b0-3dd95a0f0f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39825d6f-5d95-4b1d-84b0-3dd95a0f0f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3942e6-a1e2-4257-bfcd-f3821633cd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Volume 3715d67e-43c6-42c6-be10-7271d9d9e9a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2', 'volume_size': 1, 'image_id': 'd64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe4a406c6c72d4cea6d78b5861844fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2475da5e370549e2b4e8f2cec921e620', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fca1881a11f81d7a05a8566522f51ca41445789b0d202bd7793c6cb10bae5b6ef6ea0abfdd1a9a1f2fc265cd1d6afe43c01eeef2c941be0a8eb9dec5c324ee74', 'id': 'd64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'created_at': datetime.datetime(2026, 11, 6, 18, 52, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 52, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Trying to clone 3715d67e-43c6-42c6-be10-7271d9d9e9a2 from image d64d3f3b-2e7f-4d68-9950-9b5264fe349d at location (None, [{'url': 'file:///opt/stack/data/glance/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:52:05 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:52:05 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Image download 0.00 MB at 0.00 MB/s Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[798daac3-78ff-431a-b99b-78d4f39ba4bb]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:06 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD Nov 06 19:52:06 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:06 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:06 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD Nov 06 19:52:06 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:06 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Temporary image d64d3f3b-2e7f-4d68-9950-9b5264fe349d is fetched for user adf1d97fefc14e0eb49425d14904d9eb. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe7471-af95-49f8-9c93-0cee537a3aca]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:06 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD Nov 06 19:52:06 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:07 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:07 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD Nov 06 19:52:07 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:07 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3715d67e-43c6-42c6-be10-7271d9d9e9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2475da5e370549e2b4e8f2cec921e620',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:06Z,use_quota=True,user_id='adf1d97fefc14e0eb49425d14904d9eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c9b4252-311d-4d1e-b3af-2b819f9a32f4),volume_type_id=4c9b4252-311d-4d1e-b3af-2b819f9a32f4)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Creating volume 3715d67e-43c6-42c6-be10-7271d9d9e9a2 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:52:07 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:07 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 1073741824 Nov 06 19:52:07 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:07 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 1073741824" returned: 0 in 0.411s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:07 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 Nov 06 19:52:07 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:08 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2" returned: 0 in 0.239s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Attempting download of d64d3f3b-2e7f-4d68-9950-9b5264fe349d ((None, [{'url': 'file:///opt/stack/data/glance/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'metadata': {}}])) to volume 3715d67e-43c6-42c6-be10-7271d9d9e9a2. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb90dcf7-5567-4362-a3b3-147c79861494]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_ig395qeh {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:08 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_ig395qeh Nov 06 19:52:08 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:08 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_ig395qeh" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_ig395qeh {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:08 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_ig395qeh Nov 06 19:52:08 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:08 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_ig395qeh" returned: 1 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_ig395qeh' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda5403-e626-4ec0-8d95-ebb28bd4d1d3]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:08 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD Nov 06 19:52:08 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:09 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:09 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD Nov 06 19:52:09 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:09 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] d64d3f3b-2e7f-4d68-9950-9b5264fe349d was raw, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:09 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 Nov 06 19:52:09 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:09 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2" returned: 0 in 0.444s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d64d3f3b-2e7f-4d68-9950-9b5264fe349d_t_0a5ehadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:52:09 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 19:52:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:09 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 1G Nov 06 19:52:09 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:10 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 1G" returned: 0 in 0.304s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Downloaded image d64d3f3b-2e7f-4d68-9950-9b5264fe349d ((None, [{'url': 'file:///opt/stack/data/glance/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'metadata': {}}])) to volume 3715d67e-43c6-42c6-be10-7271d9d9e9a2 successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Temporary image d64d3f3b-2e7f-4d68-9950-9b5264fe349d for user adf1d97fefc14e0eb49425d14904d9eb is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Marking volume 3715d67e-43c6-42c6-be10-7271d9d9e9a2 as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Copying metadata from image d64d3f3b-2e7f-4d68-9950-9b5264fe349d to 3715d67e-43c6-42c6-be10-7271d9d9e9a2. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Creating volume glance metadata for volume 3715d67e-43c6-42c6-be10-7271d9d9e9a2 backed by image d64d3f3b-2e7f-4d68-9950-9b5264fe349d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bbe4a406c6c72d4cea6d78b5861844fa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3942e6-a1e2-4257-bfcd-f3821633cd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2', 'volume_size': 1, 'image_id': 'd64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbe4a406c6c72d4cea6d78b5861844fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2475da5e370549e2b4e8f2cec921e620', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fca1881a11f81d7a05a8566522f51ca41445789b0d202bd7793c6cb10bae5b6ef6ea0abfdd1a9a1f2fc265cd1d6afe43c01eeef2c941be0a8eb9dec5c324ee74', 'id': 'd64d3f3b-2e7f-4d68-9950-9b5264fe349d', 'created_at': datetime.datetime(2026, 11, 6, 18, 52, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 52, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d64d3f3b-2e7f-4d68-9950-9b5264fe349d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1586db39-5770-4228-a026-7c144da6903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:10 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Volume volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 (3715d67e-43c6-42c6-be10-7271d9d9e9a2): created successfully Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1586db39-5770-4228-a026-7c144da6903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Flow 'volume_create_manager' (31fc7182-7bb6-4cbc-ac5a-deb299c6799f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-edf4aba3-8951-4f28-b17d-f024237298af tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Created volume successfully. Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Acquiring lock "cinder-3715d67e-43c6-42c6-be10-7271d9d9e9a2-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "cinder-3715d67e-43c6-42c6-be10-7271d9d9e9a2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Acquiring lock "cinder-quobyte-3715d67e-43c6-42c6-be10-7271d9d9e9a2" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "cinder-quobyte-3715d67e-43c6-42c6-be10-7271d9d9e9a2" acquired by "delete_volume" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a94e111-e153-419a-8f32-d1f4f6729fec]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:11 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 Nov 06 19:52:11 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:11 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2" returned: 0 in 0.355s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:11 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2 Nov 06 19:52:11 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:11 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-3715d67e-43c6-42c6-be10-7271d9d9e9a2" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "cinder-quobyte-3715d67e-43c6-42c6-be10-7271d9d9e9a2" released by "delete_volume" :: held 0.640s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:11 devstack cinder-volume[86928]: WARNING cinder.quota [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:52:11 devstack cinder-volume[86928]: WARNING cinder.quota [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Created reservations ['4c635e05-6fc1-407f-b0d1-0be143cd2184', '57c1d53a-1252-4bcd-974f-fd854ffd04e7', '1515f86a-615e-4153-9be7-9c56b0f4b21b', '05ec55d3-4c08-40e0-a9f4-326413ba54d8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:11 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:52:11 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:11 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.238s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:52:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Deleted volume successfully. Nov 06 19:52:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-04957104-8407-4136-80a2-4fef9fffafa1 tempest-VolumeAndVolumeTypeFromImageTest-1921445325 None] Lock "cinder-3715d67e-43c6-42c6-be10-7271d9d9e9a2-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (5e72bfa2-5d26-4fe1-90f8-8de7c7735ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a0b8a4-92fd-4033-a6c3-e204f0b1ab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a0b8a4-92fd-4033-a6c3-e204f0b1ab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320958480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8410c3b-6917-4598-b3fe-4c4f8e77a233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:21Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deb0522-c914-40c9-a67d-2dd9b157f54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deb0522-c914-40c9-a67d-2dd9b157f54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f6e6a7-8ced-433e-aaf2-cabfbdbf374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f6e6a7-8ced-433e-aaf2-cabfbdbf374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8410c3b-6917-4598-b3fe-4c4f8e77a233', 'volume_name': 'volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cce561c-d447-41b7-b123-254df939c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cce561c-d447-41b7-b123-254df939c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f43214e-e1a8-4f2e-a698-6467fc5b08df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:20 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Volume f8410c3b-6917-4598-b3fe-4c4f8e77a233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233', 'volume_size': 1} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320958480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8410c3b-6917-4598-b3fe-4c4f8e77a233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:21Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Creating volume f8410c3b-6917-4598-b3fe-4c4f8e77a233 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:52:20 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:52:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:20 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 1073741824 Nov 06 19:52:20 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:21 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 1073741824" returned: 0 in 0.409s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:21 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 Nov 06 19:52:21 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:21 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f43214e-e1a8-4f2e-a698-6467fc5b08df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beda837-f27e-4f2d-9f95-e0cd80aa49d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:21 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Volume volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 (f8410c3b-6917-4598-b3fe-4c4f8e77a233): created successfully Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beda837-f27e-4f2d-9f95-e0cd80aa49d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (5e72bfa2-5d26-4fe1-90f8-8de7c7735ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-10a227ba-7e77-40b4-846f-d10508cc24f4 tempest-ProjectReaderTests-1143843652 None] Created volume successfully. Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-f8410c3b-6917-4598-b3fe-4c4f8e77a233-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Lock "cinder-f8410c3b-6917-4598-b3fe-4c4f8e77a233-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-quobyte-f8410c3b-6917-4598-b3fe-4c4f8e77a233" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-f8410c3b-6917-4598-b3fe-4c4f8e77a233" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0182d1d-bfba-4bd7-beaf-094e66ca1c2a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:22 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 Nov 06 19:52:22 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:22 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233" returned: 0 in 0.357s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:22 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233 Nov 06 19:52:22 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:22 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f8410c3b-6917-4598-b3fe-4c4f8e77a233" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-f8410c3b-6917-4598-b3fe-4c4f8e77a233" released by "delete_volume" :: held 0.646s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Created reservations ['69850d8c-616d-4292-838b-878dd07d9180', 'a472a5be-f462-4923-81bf-fbffe11b8d55', '14bbedb6-6371-4c6f-a712-d9f4cc626a0e', '511491c8-9323-4824-9fda-aa08b26691f5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:22 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:52:22 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:22 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.262s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:22 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:52:22 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Deleted volume successfully. Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a10a45c5-2220-4d3f-9fbd-d9cf5a1b308b tempest-ProjectReaderTests-1143843652 None] Lock "cinder-f8410c3b-6917-4598-b3fe-4c4f8e77a233-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (166d40f1-f7d8-4d0a-a970-47dab0a650fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff707467-e3d7-4958-9464-f4924bd1e836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff707467-e3d7-4958-9464-f4924bd1e836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387667211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecbc79b-0516-4d0e-9e0a-75b344916477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:23Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7498d812-1365-447c-9fd0-bdc5ddb33495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7498d812-1365-447c-9fd0-bdc5ddb33495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c2714-11e8-4727-9640-903ef07bee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862c2714-11e8-4727-9640-903ef07bee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecbc79b-0516-4d0e-9e0a-75b344916477', 'volume_name': 'volume-2ecbc79b-0516-4d0e-9e0a-75b344916477', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b9a1e6-8c9c-4628-9305-79709ddf0379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b9a1e6-8c9c-4628-9305-79709ddf0379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facf8035-5c5f-455a-b9e9-147c5cdfa5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:23 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Volume 2ecbc79b-0516-4d0e-9e0a-75b344916477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecbc79b-0516-4d0e-9e0a-75b344916477', 'volume_size': 1} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387667211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecbc79b-0516-4d0e-9e0a-75b344916477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:23Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Creating volume 2ecbc79b-0516-4d0e-9e0a-75b344916477 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:52:23 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:23 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 1073741824 Nov 06 19:52:23 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:23 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 1073741824" returned: 0 in 0.413s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:24 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 Nov 06 19:52:24 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:24 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477" returned: 0 in 0.241s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facf8035-5c5f-455a-b9e9-147c5cdfa5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecbc79b-0516-4d0e-9e0a-75b344916477', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbc3463-729d-4d1f-a6ef-e1d3ab70b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:24 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Volume volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 (2ecbc79b-0516-4d0e-9e0a-75b344916477): created successfully Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbc3463-729d-4d1f-a6ef-e1d3ab70b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (166d40f1-f7d8-4d0a-a970-47dab0a650fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:24 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e51f5d11-f43b-46d6-8a5c-fc4bde05459f tempest-ProjectReaderTests-1143843652 None] Created volume successfully. Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-2ecbc79b-0516-4d0e-9e0a-75b344916477-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-2ecbc79b-0516-4d0e-9e0a-75b344916477-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-quobyte-2ecbc79b-0516-4d0e-9e0a-75b344916477" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-2ecbc79b-0516-4d0e-9e0a-75b344916477" acquired by "delete_volume" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaaf949-c57d-4f9f-9175-27e3f0e93f60]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:24 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 Nov 06 19:52:24 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:24 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477" returned: 0 in 0.350s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:24 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477 Nov 06 19:52:24 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:25 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2ecbc79b-0516-4d0e-9e0a-75b344916477" returned: 0 in 0.246s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-2ecbc79b-0516-4d0e-9e0a-75b344916477" released by "delete_volume" :: held 0.638s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Created reservations ['ef8a1836-e85f-42ee-bdbb-ec4b99de676d', '254babd9-e3a3-4a6f-b7fc-cf7c1fc7b474', '42fcdf77-7c95-471f-9755-4bc1e825c28a', '4f740f48-c66a-4ffa-9ab2-d1f993a90185'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:25 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:52:25 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:25 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:52:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Deleted volume successfully. Nov 06 19:52:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-53985a37-3e70-4149-aadf-f2af5fb81ed2 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-2ecbc79b-0516-4d0e-9e0a-75b344916477-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (c2ac6e13-3608-49ac-a2d9-a83dfc6c9037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57771267-9dba-4c4a-8237-0a398f7c86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57771267-9dba-4c4a-8237-0a398f7c86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037058447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0316754b-7b74-4f9b-abd1-6a9e37c69d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:26Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bbd222-e977-4aff-b94c-f548020634d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bbd222-e977-4aff-b94c-f548020634d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba7a9f1-88d1-4f47-9b0a-8b2b25ca4235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba7a9f1-88d1-4f47-9b0a-8b2b25ca4235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0316754b-7b74-4f9b-abd1-6a9e37c69d46', 'volume_name': 'volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75a2954-1a7a-401d-b932-56f1bcbaf23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75a2954-1a7a-401d-b932-56f1bcbaf23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3d4612-d0e9-48ff-ba7f-4467761d86c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:26 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Volume 0316754b-7b74-4f9b-abd1-6a9e37c69d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46', 'volume_size': 1} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037058447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0316754b-7b74-4f9b-abd1-6a9e37c69d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:26Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Creating volume 0316754b-7b74-4f9b-abd1-6a9e37c69d46 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:52:26 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:26 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 1073741824 Nov 06 19:52:26 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:26 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 1073741824" returned: 0 in 0.415s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:26 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 Nov 06 19:52:26 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:26 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46" returned: 0 in 0.241s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3d4612-d0e9-48ff-ba7f-4467761d86c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163597d-282a-47b6-bbaf-940c5c685130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:26 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Volume volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 (0316754b-7b74-4f9b-abd1-6a9e37c69d46): created successfully Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163597d-282a-47b6-bbaf-940c5c685130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (c2ac6e13-3608-49ac-a2d9-a83dfc6c9037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9636dcb1-d336-466d-bc73-a3395c325349 tempest-ProjectReaderTests-1143843652 None] Created volume successfully. Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-0316754b-7b74-4f9b-abd1-6a9e37c69d46-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Lock "cinder-0316754b-7b74-4f9b-abd1-6a9e37c69d46-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-quobyte-0316754b-7b74-4f9b-abd1-6a9e37c69d46" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-0316754b-7b74-4f9b-abd1-6a9e37c69d46" acquired by "delete_volume" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a4b4cc-f8ab-4d74-90e8-050e97ece6a9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:27 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 Nov 06 19:52:27 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:27 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46" returned: 0 in 0.358s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:27 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46 Nov 06 19:52:27 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:27 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0316754b-7b74-4f9b-abd1-6a9e37c69d46" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-0316754b-7b74-4f9b-abd1-6a9e37c69d46" released by "delete_volume" :: held 0.645s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Created reservations ['cd4c57d5-7f2a-4bd8-a77c-5dd55eebdcc8', 'f86057cd-0dff-491c-844a-50cd9a0457ba', '5ef81803-563e-4f4e-b366-c1c8487444a8', 'bdb43afc-f9a6-411d-bc94-df4d798e9e73'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:28 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:52:28 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:28 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.239s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:52:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Deleted volume successfully. Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-61591f5b-e36e-4cd7-a873-94f2f489664a tempest-ProjectReaderTests-1143843652 None] Lock "cinder-0316754b-7b74-4f9b-abd1-6a9e37c69d46-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (b54f85cf-a172-47e4-8511-59af64aa20d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67ef219-6888-4f0c-8e79-6213e93f56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67ef219-6888-4f0c-8e79-6213e93f56e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410406009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1877bc52-87a3-44c2-aa0f-df16264dc986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:29Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38648971-cc7f-4cc4-b693-4db1ad530b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38648971-cc7f-4cc4-b693-4db1ad530b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b52188-3fb5-43f4-90de-97977479a5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b52188-3fb5-43f4-90de-97977479a5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1877bc52-87a3-44c2-aa0f-df16264dc986', 'volume_name': 'volume-1877bc52-87a3-44c2-aa0f-df16264dc986', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292ede1d-05ba-4adc-bf0a-fbbd23dd8dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292ede1d-05ba-4adc-bf0a-fbbd23dd8dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef3db26-abd5-4fb5-80eb-90d59572fc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:28 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Volume 1877bc52-87a3-44c2-aa0f-df16264dc986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1877bc52-87a3-44c2-aa0f-df16264dc986', 'volume_size': 1} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410406009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1877bc52-87a3-44c2-aa0f-df16264dc986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfa87be143594b7abe9d8e80a339eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:29Z,use_quota=True,user_id='040ef6311bcf4a6490378c226d71a61b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Creating volume 1877bc52-87a3-44c2-aa0f-df16264dc986 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:52:28 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:52:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:28 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 1073741824 Nov 06 19:52:28 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:29 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 1073741824" returned: 0 in 0.406s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:29 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 Nov 06 19:52:29 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:29 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986" returned: 0 in 0.244s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef3db26-abd5-4fb5-80eb-90d59572fc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1877bc52-87a3-44c2-aa0f-df16264dc986', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbd8fec-0b4c-44e3-a8a5-f1654a7e1336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:29 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Volume volume-1877bc52-87a3-44c2-aa0f-df16264dc986 (1877bc52-87a3-44c2-aa0f-df16264dc986): created successfully Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbd8fec-0b4c-44e3-a8a5-f1654a7e1336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Flow 'volume_create_manager' (b54f85cf-a172-47e4-8511-59af64aa20d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a32967de-7827-48be-afd0-ef48841598c1 tempest-ProjectReaderTests-1143843652 None] Created volume successfully. Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-1877bc52-87a3-44c2-aa0f-df16264dc986-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-1877bc52-87a3-44c2-aa0f-df16264dc986-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "cinder-quobyte-1877bc52-87a3-44c2-aa0f-df16264dc986" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-1877bc52-87a3-44c2-aa0f-df16264dc986" acquired by "delete_volume" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c223789-934c-4476-a038-431c040daa00]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:29 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 Nov 06 19:52:29 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:30 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986" returned: 0 in 0.349s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:30 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986 Nov 06 19:52:30 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:30 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1877bc52-87a3-44c2-aa0f-df16264dc986" returned: 0 in 0.238s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-quobyte-1877bc52-87a3-44c2-aa0f-df16264dc986" released by "delete_volume" :: held 0.627s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Created reservations ['995a8f91-885d-415f-86a7-68376f0e2c02', 'c02213e6-9ab8-41b5-95ab-f1888790c47f', 'ea031579-af4e-4440-88b7-cb7efbe4f3cb', '1581f518-11e6-49c8-8c9c-874125187bf3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:30 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:52:30 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:30 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.241s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:52:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Deleted volume successfully. Nov 06 19:52:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0d91743a-100f-4546-8d4f-54aa3f4c89b0 tempest-ProjectReaderTests-1143843652 None] Lock "cinder-1877bc52-87a3-44c2-aa0f-df16264dc986-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:47 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:52:47 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:47 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.235s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:52:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:52:48 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=55,cinder:SELECT=40,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:52:48 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=43,cinder:INSERT=16,cinder:UPDATE=59,cinder:DELETE=5 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Flow 'volume_create_manager' (6c5434e0-d371-47a9-9221-44e944a3f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b35d0d6-ed76-4f9b-9562-571306d023d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b35d0d6-ed76-4f9b-9562-571306d023d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-456890050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae2909d-63c9-4edc-833c-14d1279691d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71661ce374441108efb5c060c282481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:53Z,use_quota=True,user_id='aea784f72bd74754b8a458ed917062ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b491c7e-208b-495d-b865-cf361a82c978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b491c7e-208b-495d-b865-cf361a82c978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f53ad5-6f22-41ee-a7bb-14896f760a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f53ad5-6f22-41ee-a7bb-14896f760a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae2909d-63c9-4edc-833c-14d1279691d4', 'volume_name': 'volume-fae2909d-63c9-4edc-833c-14d1279691d4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdd5a19-71e4-4d8d-b412-cb707aaf160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdd5a19-71e4-4d8d-b412-cb707aaf160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c7d63-54fd-46cb-999d-b90112b54a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Volume fae2909d-63c9-4edc-833c-14d1279691d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae2909d-63c9-4edc-833c-14d1279691d4', 'volume_size': 1} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-456890050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae2909d-63c9-4edc-833c-14d1279691d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71661ce374441108efb5c060c282481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:53Z,use_quota=True,user_id='aea784f72bd74754b8a458ed917062ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Creating volume fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:52:52 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:52:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:52 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 1073741824 Nov 06 19:52:52 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:53 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 1073741824" returned: 0 in 0.404s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:53 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 Nov 06 19:52:53 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:53 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c7d63-54fd-46cb-999d-b90112b54a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae2909d-63c9-4edc-833c-14d1279691d4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cdc176-c0bc-4b35-aba0-7f087aaa53c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Volume volume-fae2909d-63c9-4edc-833c-14d1279691d4 (fae2909d-63c9-4edc-833c-14d1279691d4): created successfully Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cdc176-c0bc-4b35-aba0-7f087aaa53c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Flow 'volume_create_manager' (6c5434e0-d371-47a9-9221-44e944a3f02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e6bd96f2-c650-47d3-af65-979a216fab2b tempest-SnapshotDependencyTests-1887761594 None] Created volume successfully. Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Creating offline snapshot 65e9a5aa-83e9-4e6a-9366-60c820811e70 of volume fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[24767c3e-29f7-4ca5-820a-2b6c8c3c0e1e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:54 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 Nov 06 19:52:54 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:54 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4" returned: 0 in 0.344s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:54 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 1G Nov 06 19:52:54 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:54 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 1G" returned: 0 in 0.384s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae2909d-63c9-4edc-833c-14d1279691d4 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:54 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae2909d-63c9-4edc-833c-14d1279691d4 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 Nov 06 19:52:54 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:55 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae2909d-63c9-4edc-833c-14d1279691d4 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:55 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 is being set with open permissions: ugo+rw Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:55 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 Nov 06 19:52:55 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:55 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70" returned: 0 in 0.241s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:55 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.info Nov 06 19:52:55 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:55 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.info" returned: 0 in 0.238s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:55 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.info is being set with open permissions: ugo+rw Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:55 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.info Nov 06 19:52:55 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:55 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.info" returned: 0 in 0.239s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:55 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-73c46ee8-bb6a-44e8-bf2f-006ff8843eaa tempest-SnapshotDependencyTests-1887761594 None] Create snapshot completed successfully Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Flow 'volume_create_manager' (b63a9e98-cd14-4b6c-a893-7844bcdbcfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f83e64-9130-4c93-b867-56370ae0610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f83e64-9130-4c93-b867-56370ae0610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6056cbf9-54f8-4635-9c5f-46b5c122e288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71661ce374441108efb5c060c282481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=65e9a5aa-83e9-4e6a-9366-60c820811e70,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:52:57Z,use_quota=True,user_id='aea784f72bd74754b8a458ed917062ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc24770-5023-4b59-a6a6-e41c6c1ba556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc24770-5023-4b59-a6a6-e41c6c1ba556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a992f3b-2817-4c07-b78c-7e3a53c3cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a992f3b-2817-4c07-b78c-7e3a53c3cf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6056cbf9-54f8-4635-9c5f-46b5c122e288', 'volume_name': 'volume-6056cbf9-54f8-4635-9c5f-46b5c122e288', 'volume_size': 1, 'snapshot_id': '65e9a5aa-83e9-4e6a-9366-60c820811e70'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116d2060-a8f1-43fa-b4dc-3f3d3a584312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116d2060-a8f1-43fa-b4dc-3f3d3a584312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a167a9-253f-4b8e-9de5-57ff9cf0f661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:52:56 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Volume 6056cbf9-54f8-4635-9c5f-46b5c122e288: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6056cbf9-54f8-4635-9c5f-46b5c122e288', 'volume_size': 1, 'snapshot_id': '65e9a5aa-83e9-4e6a-9366-60c820811e70'} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-quobyte-65e9a5aa-83e9-4e6a-9366-60c820811e70-6056cbf9-54f8-4635-9c5f-46b5c122e288" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-65e9a5aa-83e9-4e6a-9366-60c820811e70-6056cbf9-54f8-4635-9c5f-46b5c122e288" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Creating volume 6056cbf9-54f8-4635-9c5f-46b5c122e288 from snapshot 65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-quobyte-6056cbf9-54f8-4635-9c5f-46b5c122e288" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-6056cbf9-54f8-4635-9c5f-46b5c122e288" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] snapshot: 65e9a5aa-83e9-4e6a-9366-60c820811e70, volume: 6056cbf9-54f8-4635-9c5f-46b5c122e288, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c45c0-7b3a-4177-bfb2-398e3743aca9]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:57 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 Nov 06 19:52:57 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:57 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70" returned: 0 in 0.361s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fae2909d-63c9-4edc-833c-14d1279691d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[be391bc2-b97f-4734-ad72-486cde2b77ce]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:57 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 Nov 06 19:52:57 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:52:57 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4" returned: 0 in 0.376s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:52:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:52:57 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 Nov 06 19:52:57 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:03 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288" returned: 0 in 5.762s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:53:03 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Converted 1024.00 MB image at 177.67 MB/s Nov 06 19:53:03 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 is being set with open permissions: ugo+rw Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:03 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 Nov 06 19:53:03 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:03 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-6056cbf9-54f8-4635-9c5f-46b5c122e288" released by "_copy_volume_from_snapshot" :: held 6.816s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-65e9a5aa-83e9-4e6a-9366-60c820811e70-6056cbf9-54f8-4635-9c5f-46b5c122e288" released by "_create_volume_from_snapshot" :: held 6.873s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.888s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a167a9-253f-4b8e-9de5-57ff9cf0f661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6056cbf9-54f8-4635-9c5f-46b5c122e288', 'volume_size': 1, 'snapshot_id': '65e9a5aa-83e9-4e6a-9366-60c820811e70'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311b6b24-9bb9-4bc0-b720-6583f2f2123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:03 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Volume volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 (6056cbf9-54f8-4635-9c5f-46b5c122e288): created successfully Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311b6b24-9bb9-4bc0-b720-6583f2f2123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Flow 'volume_create_manager' (b63a9e98-cd14-4b6c-a893-7844bcdbcfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d5c176ca-9ae3-4deb-b265-542b6eb96245 tempest-SnapshotDependencyTests-1887761594 None] Created volume successfully. Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-65e9a5aa-83e9-4e6a-9366-60c820811e70-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-65e9a5aa-83e9-4e6a-9366-60c820811e70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-quobyte-fae2909d-63c9-4edc-833c-14d1279691d4" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-fae2909d-63c9-4edc-833c-14d1279691d4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-quobyte-65e9a5aa-83e9-4e6a-9366-60c820811e70" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-65e9a5aa-83e9-4e6a-9366-60c820811e70" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Deleting offline snapshot 65e9a5aa-83e9-4e6a-9366-60c820811e70 of volume fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] snapshot_file for this snap is: volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f718dc80-880e-4fac-980f-206319d41254]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:04 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 Nov 06 19:53:04 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:04 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70" returned: 0 in 0.348s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fae2909d-63c9-4edc-833c-14d1279691d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[52946695-f20f-43aa-84f4-eac3499f6784]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:04 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 Nov 06 19:53:04 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:05 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4" returned: 0 in 0.513s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:05 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 Nov 06 19:53:05 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:05 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:05 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70 Nov 06 19:53:05 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:05 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4.65e9a5aa-83e9-4e6a-9366-60c820811e70" returned: 0 in 0.232s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-65e9a5aa-83e9-4e6a-9366-60c820811e70" released by "_delete_snapshot" :: held 1.510s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-fae2909d-63c9-4edc-833c-14d1279691d4" released by "delete_snapshot" :: held 1.532s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Created reservations ['453e7b8a-36f0-4de1-a94e-63e4cbbeebd3', 'fd595b3a-f083-46df-b313-8aaf01891eba', 'a4b3a28b-4f63-4123-80bd-175c04f62ff5', '13e48062-8eb9-4d1e-813a-bfce7417bc7d'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Delete snapshot completed successfully. Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8404cdef-72a2-41a7-af81-4d75d13d901b tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-65e9a5aa-83e9-4e6a-9366-60c820811e70-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-fae2909d-63c9-4edc-833c-14d1279691d4-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-fae2909d-63c9-4edc-833c-14d1279691d4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-quobyte-fae2909d-63c9-4edc-833c-14d1279691d4" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-fae2909d-63c9-4edc-833c-14d1279691d4" acquired by "delete_volume" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd30dc29-92b8-41fb-9ee2-91eae0ff4fb7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:06 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 Nov 06 19:53:06 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:07 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4" returned: 0 in 0.350s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:07 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4 Nov 06 19:53:07 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:07 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-fae2909d-63c9-4edc-833c-14d1279691d4" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-fae2909d-63c9-4edc-833c-14d1279691d4" released by "delete_volume" :: held 0.641s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Created reservations ['5f765bb8-6ad2-4a01-9679-960cd71b68df', 'ddcce742-9f89-455b-8274-d59e8fffbfcc', 'ef477b1f-66d4-4744-8471-40f59ce76127', '86e781ca-1f6e-4203-843d-3f2a4968ed89'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:07 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:07 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:07 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.239s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:07 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Deleted volume successfully. Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-217c7c1b-2f75-48b1-b6ee-13059fdc4970 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-fae2909d-63c9-4edc-833c-14d1279691d4-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-6056cbf9-54f8-4635-9c5f-46b5c122e288-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-6056cbf9-54f8-4635-9c5f-46b5c122e288-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "cinder-quobyte-6056cbf9-54f8-4635-9c5f-46b5c122e288" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-6056cbf9-54f8-4635-9c5f-46b5c122e288" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e1cd5d-e3c8-47fc-b3fd-4166648b262d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:07 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 Nov 06 19:53:07 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:08 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288" returned: 0 in 0.353s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:08 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288 Nov 06 19:53:08 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:08 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6056cbf9-54f8-4635-9c5f-46b5c122e288" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-quobyte-6056cbf9-54f8-4635-9c5f-46b5c122e288" released by "delete_volume" :: held 0.627s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Created reservations ['747cec69-6659-4853-b9a4-e99374ed4269', 'd074b572-ab4b-422a-92cb-13c9b8478fa8', '315acaf4-4156-482b-b656-69a96110ba68', 'e3cb0042-656e-40a2-aadd-d73c65b82ce8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:08 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:08 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:08 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Deleted volume successfully. Nov 06 19:53:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6547e92a-768f-4958-89de-4687d0a91829 tempest-SnapshotDependencyTests-1887761594 None] Lock "cinder-6056cbf9-54f8-4635-9c5f-46b5c122e288-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:18 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:53:18 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (977bc5ac-de40-43b1-85e9-986105234d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f84bbf-83e1-491e-af97-c9e89c9fe8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f84bbf-83e1-491e-af97-c9e89c9fe8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724247042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d06b46-af3e-470c-a1b3-edec94c15bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:29Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4909be-4ee9-4270-aecd-a4fbc330e9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4909be-4ee9-4270-aecd-a4fbc330e9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad9b29f-7e6d-481f-9087-af1ce25e2552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad9b29f-7e6d-481f-9087-af1ce25e2552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d06b46-af3e-470c-a1b3-edec94c15bb0', 'volume_name': 'volume-66d06b46-af3e-470c-a1b3-edec94c15bb0', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d0f247-3afa-4f2a-b638-3a43c8e89e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d0f247-3afa-4f2a-b638-3a43c8e89e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac2d179-f319-4ea2-a347-479dab009a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Volume 66d06b46-af3e-470c-a1b3-edec94c15bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d06b46-af3e-470c-a1b3-edec94c15bb0', 'volume_size': 1} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724247042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d06b46-af3e-470c-a1b3-edec94c15bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:29Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Creating volume 66d06b46-af3e-470c-a1b3-edec94c15bb0 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:29 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:29 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 1073741824 Nov 06 19:53:29 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (6b569a72-b4d5-4b49-9a25-a6188caae203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9700821e-dafc-471a-8239-62f4f6a81b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9700821e-dafc-471a-8239-62f4f6a81b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-229123366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cdcb802-172c-4fcc-bd32-9362a01929d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f82dfdf-cdba-4d36-86ba-5f7794ce8d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f82dfdf-cdba-4d36-86ba-5f7794ce8d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd865c6-7446-4c8e-a137-65fd4b2941ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd865c6-7446-4c8e-a137-65fd4b2941ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cdcb802-172c-4fcc-bd32-9362a01929d8', 'volume_name': 'volume-8cdcb802-172c-4fcc-bd32-9362a01929d8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1595d2bd-7044-44d3-9912-2357f9bb37f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1595d2bd-7044-44d3-9912-2357f9bb37f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac439cc-21c7-4749-888c-d5df0ef59855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:29 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume 8cdcb802-172c-4fcc-bd32-9362a01929d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cdcb802-172c-4fcc-bd32-9362a01929d8', 'volume_size': 1} Nov 06 19:53:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (175c0220-5160-49d1-ab0a-5f576b9c699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148181c5-bb56-427f-96cf-da617fe08984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148181c5-bb56-427f-96cf-da617fe08984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1662849849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07780305-b604-4507-91dd-f5c9b38918ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3da2c4-c5b3-4691-91b5-3da6c98dbe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3da2c4-c5b3-4691-91b5-3da6c98dbe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052f413e-63b8-4c84-ad6b-6edffe0228f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052f413e-63b8-4c84-ad6b-6edffe0228f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07780305-b604-4507-91dd-f5c9b38918ea', 'volume_name': 'volume-07780305-b604-4507-91dd-f5c9b38918ea', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe217aa-9739-4792-b88a-f1b2e202dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe217aa-9739-4792-b88a-f1b2e202dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b3b8e7-cda5-47d3-88d9-d10401525338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Volume 07780305-b604-4507-91dd-f5c9b38918ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07780305-b604-4507-91dd-f5c9b38918ea', 'volume_size': 1} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Flow 'volume_create_manager' (115441cf-315f-4db3-b2f8-ef17d4af1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807e43a5-60fb-4138-8348-620db206ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807e43a5-60fb-4138-8348-620db206ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168d1ada-772d-4930-89c2-ba79728fb3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0be0a1ef614fc3a56cb9eaee7888e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='b841a7c5a9904d4da8a929fc57e64c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da61f1a6-8a1f-4a6c-82f3-f869a7aa15af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da61f1a6-8a1f-4a6c-82f3-f869a7aa15af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5b5db5-8bad-4dd9-9638-4313ce98598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5b5db5-8bad-4dd9-9638-4313ce98598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168d1ada-772d-4930-89c2-ba79728fb3f6', 'volume_name': 'volume-168d1ada-772d-4930-89c2-ba79728fb3f6', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033885e7-ed0e-4a1b-8f13-91da27b4ccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033885e7-ed0e-4a1b-8f13-91da27b4ccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a8165a-0524-466c-891f-9d1bc476f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Volume 168d1ada-772d-4930-89c2-ba79728fb3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168d1ada-772d-4930-89c2-ba79728fb3f6', 'volume_size': 1} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:30 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 1073741824" returned: 0 in 0.865s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (0a18728e-85f0-4db5-8de0-88b4af7b96b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b162d27-6910-459b-a12f-5a679d96c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b162d27-6910-459b-a12f-5a679d96c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1817366633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b872c865-33c3-4777-ab02-5cda36daafeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b212e0-30ca-498c-8aa5-2b16ae50142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b212e0-30ca-498c-8aa5-2b16ae50142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abab50e8-e9d4-44cc-b11d-3075dffa2edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abab50e8-e9d4-44cc-b11d-3075dffa2edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b872c865-33c3-4777-ab02-5cda36daafeb', 'volume_name': 'volume-b872c865-33c3-4777-ab02-5cda36daafeb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437e4b79-cd31-491e-b9d9-c9cfa3a488a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437e4b79-cd31-491e-b9d9-c9cfa3a488a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110dcd18-e298-4547-9d41-52baaf8a9948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Volume b872c865-33c3-4777-ab02-5cda36daafeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b872c865-33c3-4777-ab02-5cda36daafeb', 'volume_size': 1} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:30 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 Nov 06 19:53:30 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (59f21bd4-0ea6-461d-94a7-3c7dc5a815ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759f7a9d-4513-4ff8-a02d-54c1a4b42ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759f7a9d-4513-4ff8-a02d-54c1a4b42ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763456551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d408a816-502b-4db1-826f-4008526aacf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:31Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be896ae-5b5b-45fc-84bc-849f5a1e8621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be896ae-5b5b-45fc-84bc-849f5a1e8621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410d8f3d-f9c2-45f1-9773-c7ce3c73c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410d8f3d-f9c2-45f1-9773-c7ce3c73c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd408a816-502b-4db1-826f-4008526aacf9', 'volume_name': 'volume-d408a816-502b-4db1-826f-4008526aacf9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c8da9a-2484-4924-9a70-1838daf8ec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c8da9a-2484-4924-9a70-1838daf8ec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b038a9f-4769-4fad-a3dd-fcd12858aceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Volume d408a816-502b-4db1-826f-4008526aacf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d408a816-502b-4db1-826f-4008526aacf9', 'volume_size': 1} Nov 06 19:53:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:31 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0" returned: 0 in 0.315s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-229123366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cdcb802-172c-4fcc-bd32-9362a01929d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Creating volume 8cdcb802-172c-4fcc-bd32-9362a01929d8 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:31 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac2d179-f319-4ea2-a347-479dab009a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d06b46-af3e-470c-a1b3-edec94c15bb0', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcc9974-94ce-48c6-bb54-e888714c9151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:31 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 1073741824 Nov 06 19:53:31 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Volume volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 (66d06b46-af3e-470c-a1b3-edec94c15bb0): created successfully Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcc9974-94ce-48c6-bb54-e888714c9151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (977bc5ac-de40-43b1-85e9-986105234d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7adc033d-6b43-4098-a65b-f8d0847c3aef tempest-CreateVolumesFromImageTest-1664052976 None] Created volume successfully. Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (b602758e-1822-44a9-97e3-958d50d73301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b95a770-84ac-416d-bfd3-7f1003ab12c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b95a770-84ac-416d-bfd3-7f1003ab12c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-307584977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1e4ce-0282-446b-b97c-9be76d3e480c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:31Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccadd70-5602-46df-a696-9476a87204fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccadd70-5602-46df-a696-9476a87204fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3c5240-5825-4b31-81e1-cbf9ebf6c1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3c5240-5825-4b31-81e1-cbf9ebf6c1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae1e4ce-0282-446b-b97c-9be76d3e480c', 'volume_name': 'volume-bae1e4ce-0282-446b-b97c-9be76d3e480c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15cf977-394b-45f3-bd1f-c8f6c96138f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15cf977-394b-45f3-bd1f-c8f6c96138f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e798c1-55a7-4da4-abab-a557d46c4db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Volume bae1e4ce-0282-446b-b97c-9be76d3e480c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae1e4ce-0282-446b-b97c-9be76d3e480c', 'volume_size': 1} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:31 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 1073741824" returned: 0 in 0.511s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:31 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 Nov 06 19:53:31 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:31 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1662849849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07780305-b604-4507-91dd-f5c9b38918ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Creating volume 07780305-b604-4507-91dd-f5c9b38918ea {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:31 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac439cc-21c7-4749-888c-d5df0ef59855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cdcb802-172c-4fcc-bd32-9362a01929d8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea 1073741824 Nov 06 19:53:31 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3f0b92-0ce4-4126-8098-d3f992b36787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 (8cdcb802-172c-4fcc-bd32-9362a01929d8): created successfully Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3f0b92-0ce4-4126-8098-d3f992b36787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (6b569a72-b4d5-4b49-9a25-a6188caae203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-83645f85-6544-4fa8-ac2d-0533b20ec92b tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created volume successfully. Nov 06 19:53:32 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea 1073741824" returned: 0 in 0.494s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:32 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea Nov 06 19:53:32 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:32 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168d1ada-772d-4930-89c2-ba79728fb3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0be0a1ef614fc3a56cb9eaee7888e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='b841a7c5a9904d4da8a929fc57e64c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Creating volume 168d1ada-772d-4930-89c2-ba79728fb3f6 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:32 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:32 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 1073741824 Nov 06 19:53:32 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b3b8e7-cda5-47d3-88d9-d10401525338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07780305-b604-4507-91dd-f5c9b38918ea', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394d7dc2-b019-431e-b923-c6c8b1ee95f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:32 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Volume volume-07780305-b604-4507-91dd-f5c9b38918ea (07780305-b604-4507-91dd-f5c9b38918ea): created successfully Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394d7dc2-b019-431e-b923-c6c8b1ee95f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:32 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (175c0220-5160-49d1-ab0a-5f576b9c699b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-55093f62-53d1-40e1-8d87-cb8ae500c4f6 tempest-CreateVolumesFromImageTest-1664052976 None] Created volume successfully. Nov 06 19:53:33 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 1073741824" returned: 0 in 0.545s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:33 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 Nov 06 19:53:33 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (395d16e4-33a9-4467-a10a-4beda3b260fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ca904-9c70-42b4-b35a-72095c230a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ca904-9c70-42b4-b35a-72095c230a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-526739172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29591d4e-e04f-42ca-95f0-f0a23d5c8fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:33Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dab1eb-1cd2-4848-9655-1943f31a2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dab1eb-1cd2-4848-9655-1943f31a2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9c2635-d749-4f25-9795-beeced35460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9c2635-d749-4f25-9795-beeced35460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29591d4e-e04f-42ca-95f0-f0a23d5c8fb5', 'volume_name': 'volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9817130-4c26-4ede-810a-a1320f6be71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9817130-4c26-4ede-810a-a1320f6be71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed4e47e-a9e3-4440-91b9-dfc287eaf61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume 29591d4e-e04f-42ca-95f0-f0a23d5c8fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5', 'volume_size': 1} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Flow 'volume_create_manager' (436becb3-fe31-489e-9d19-96b3000724ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff3ea5-8f64-4592-b8fb-7c4aa17629cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff3ea5-8f64-4592-b8fb-7c4aa17629cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d695c684-23a1-476b-bab8-c8138014425f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532eda2f20534aab853a6c01283a8d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:34Z,use_quota=True,user_id='e600ff7e784d46a49a718462e156b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9026af9d-6250-48c3-b9d8-42aea18e81a0),volume_type_id=9026af9d-6250-48c3-b9d8-42aea18e81a0)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf8a9ce-adeb-4a5f-b688-997b180f8d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf8a9ce-adeb-4a5f-b688-997b180f8d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9f072e-1c8a-4699-8f88-189683e8395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6" returned: 0 in 0.442s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1817366633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b872c865-33c3-4777-ab02-5cda36daafeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:30Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Creating volume b872c865-33c3-4777-ab02-5cda36daafeb {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:33 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a8165a-0524-466c-891f-9d1bc476f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168d1ada-772d-4930-89c2-ba79728fb3f6', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2400fc4e-4d13-4018-8213-86e33c3b11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb 1073741824 Nov 06 19:53:33 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:33 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Volume volume-168d1ada-772d-4930-89c2-ba79728fb3f6 (168d1ada-772d-4930-89c2-ba79728fb3f6): created successfully Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2400fc4e-4d13-4018-8213-86e33c3b11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Flow 'volume_create_manager' (115441cf-315f-4db3-b2f8-ef17d4af1148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3aec824d-b29e-4a1d-b531-0e2c4774cd73 tempest-CinderUnicodeTest-1369687899 None] Created volume successfully. Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (ada389b7-714a-4736-8905-76322f36bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2db799-6525-43b5-8b96-a14a687ca2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2db799-6525-43b5-8b96-a14a687ca2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775830058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c833b42-adce-448a-a50b-999ce3f9528c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:34Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081ac0d2-bd70-4a03-9606-ba134da6c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081ac0d2-bd70-4a03-9606-ba134da6c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd8ae7f-0bc3-4bf1-83b0-6250174cf4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:33 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd8ae7f-0bc3-4bf1-83b0-6250174cf4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c833b42-adce-448a-a50b-999ce3f9528c', 'volume_name': 'volume-1c833b42-adce-448a-a50b-999ce3f9528c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a8bf47-400b-4e68-8e19-f0751fbbb692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a8bf47-400b-4e68-8e19-f0751fbbb692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de438a9-92c3-4230-a439-87d4c72dfd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume 1c833b42-adce-448a-a50b-999ce3f9528c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c833b42-adce-448a-a50b-999ce3f9528c', 'volume_size': 1} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9f072e-1c8a-4699-8f88-189683e8395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd695c684-23a1-476b-bab8-c8138014425f', 'volume_name': 'volume-d695c684-23a1-476b-bab8-c8138014425f', 'volume_size': 1, 'image_id': 'd55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e072058201e1a389b70062e7e9d39b2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '532eda2f20534aab853a6c01283a8d89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '790d1d3d6009bb3ab3b0c4dcb514a4eff1428298ce4752b8e6ec5e29648acefddd5ec78913087f74b35008b38f91406b5b749eabf22868e9356b9ff73b8d7d3f', 'id': 'd55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'created_at': datetime.datetime(2026, 11, 6, 18, 53, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 53, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee42449-67aa-40f3-9166-9ade0794830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee42449-67aa-40f3-9166-9ade0794830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bfc6aa-5bd8-404f-9f4a-f03b5932a27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Volume d695c684-23a1-476b-bab8-c8138014425f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d695c684-23a1-476b-bab8-c8138014425f', 'volume_size': 1, 'image_id': 'd55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e072058201e1a389b70062e7e9d39b2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '532eda2f20534aab853a6c01283a8d89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '790d1d3d6009bb3ab3b0c4dcb514a4eff1428298ce4752b8e6ec5e29648acefddd5ec78913087f74b35008b38f91406b5b749eabf22868e9356b9ff73b8d7d3f', 'id': 'd55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'created_at': datetime.datetime(2026, 11, 6, 18, 53, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 53, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Trying to clone d695c684-23a1-476b-bab8-c8138014425f from image d55bf66a-b24f-4e7a-93a9-2e99ceaa640c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:53:34 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Image download 0.00 MB at 0.00 MB/s Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cf8939-2f7d-469a-abd8-9d735fabaffc]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:34 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (3545bcc3-1967-45d9-a34d-eef1d5e45b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d10275-69df-4aff-a839-d93982f38828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb 1073741824" returned: 0 in 0.697s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d10275-69df-4aff-a839-d93982f38828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185393661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc1dedb-e0bb-453a-9230-f301991886af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:34Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeb2ae9-bfc9-4b7a-9ebf-f11869b4c4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efeb2ae9-bfc9-4b7a-9ebf-f11869b4c4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8325fa34-ec32-48de-b893-39ed01d1e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8325fa34-ec32-48de-b893-39ed01d1e760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc1dedb-e0bb-453a-9230-f301991886af', 'volume_name': 'volume-7fc1dedb-e0bb-453a-9230-f301991886af', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f970086a-ccf8-4c11-aaab-fd065f0f86ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f970086a-ccf8-4c11-aaab-fd065f0f86ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a919878d-0ec1-4998-b8ae-e8a951ec818c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume 7fc1dedb-e0bb-453a-9230-f301991886af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc1dedb-e0bb-453a-9230-f301991886af', 'volume_size': 1} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:34 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb Nov 06 19:53:34 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:34 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:34 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb" returned: 0 in 0.412s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1763456551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d408a816-502b-4db1-826f-4008526aacf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:31Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Creating volume d408a816-502b-4db1-826f-4008526aacf9 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:34 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:34 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD Nov 06 19:53:34 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (e93553ef-d2ce-4226-9787-447c45763398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b27fa9-dc32-4f82-aa73-ff2d6a67155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 1073741824 Nov 06 19:53:35 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b27fa9-dc32-4f82-aa73-ff2d6a67155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138578658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f289af-1b68-4de5-87fb-7dced86e3cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:35Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76648e25-c1b9-42f2-8aa3-5bf47275e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76648e25-c1b9-42f2-8aa3-5bf47275e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefe2d5d-e03d-41e9-91a2-61ce3355a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefe2d5d-e03d-41e9-91a2-61ce3355a102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f289af-1b68-4de5-87fb-7dced86e3cc8', 'volume_name': 'volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ffca4f-318d-486c-be39-14b2d8fc66a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ffca4f-318d-486c-be39-14b2d8fc66a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591d4fcc-7387-43e3-8a28-ce5f8d229cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume b8f289af-1b68-4de5-87fb-7dced86e3cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8', 'volume_size': 1} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110dcd18-e298-4547-9d41-52baaf8a9948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b872c865-33c3-4777-ab02-5cda36daafeb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb464fc3-9f63-4ff2-8db6-72f235cf96dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Volume volume-b872c865-33c3-4777-ab02-5cda36daafeb (b872c865-33c3-4777-ab02-5cda36daafeb): created successfully Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb464fc3-9f63-4ff2-8db6-72f235cf96dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (0a18728e-85f0-4db5-8de0-88b4af7b96b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-04287e94-be9d-4495-a01f-3bc88b29a4f5 tempest-CreateVolumesFromImageTest-1664052976 None] Created volume successfully. Nov 06 19:53:35 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD" returned: 1 in 0.555s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Temporary image d55bf66a-b24f-4e7a-93a9-2e99ceaa640c is fetched for user e600ff7e784d46a49a718462e156b9cc. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c74d9e4-cb2c-45f1-b260-05647207f76c]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:35 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD Nov 06 19:53:35 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:35 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Flow 'volume_create_manager' (e18b53d7-e177-48f4-8fb6-49782d70723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c608a973-8dc5-4390-9614-0568daffcace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 1073741824" returned: 0 in 0.736s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c608a973-8dc5-4390-9614-0568daffcace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1495319104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632a828b-84cf-4484-93ca-b06171d7ca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0be0a1ef614fc3a56cb9eaee7888e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:36Z,use_quota=True,user_id='b841a7c5a9904d4da8a929fc57e64c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082469de-e5bb-460c-a78b-aa27b2f356c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082469de-e5bb-460c-a78b-aa27b2f356c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7ee7ee-884a-4117-b27f-eed98f557a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7ee7ee-884a-4117-b27f-eed98f557a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632a828b-84cf-4484-93ca-b06171d7ca01', 'volume_name': 'volume-632a828b-84cf-4484-93ca-b06171d7ca01', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23695a0a-7e5c-409f-98b3-759f7be38557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23695a0a-7e5c-409f-98b3-759f7be38557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c802228-b909-47e6-a3ce-8d3b8174b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Volume 632a828b-84cf-4484-93ca-b06171d7ca01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632a828b-84cf-4484-93ca-b06171d7ca01', 'volume_size': 1} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:35 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:35 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 Nov 06 19:53:35 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (cdb25c27-5f98-45ea-8370-8f17222be1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb7a581-281c-47da-802b-ae7ab7253d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb7a581-281c-47da-802b-ae7ab7253d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-257178835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111b7866-d07d-4c78-96cb-cf7081a76b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:36Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d51754d-9766-408b-8e3b-25450e1cc925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d51754d-9766-408b-8e3b-25450e1cc925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD Nov 06 19:53:35 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffb334a-2b68-49db-8b61-d614116828b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffb334a-2b68-49db-8b61-d614116828b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111b7866-d07d-4c78-96cb-cf7081a76b0e', 'volume_name': 'volume-111b7866-d07d-4c78-96cb-cf7081a76b0e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc36e167-55c7-4577-91c4-2b1f14c00816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc36e167-55c7-4577-91c4-2b1f14c00816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f684aff3-cd11-489b-8096-f98716cc6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume 111b7866-d07d-4c78-96cb-cf7081a76b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111b7866-d07d-4c78-96cb-cf7081a76b0e', 'volume_size': 1} Nov 06 19:53:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:36 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.756s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-307584977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1e4ce-0282-446b-b97c-9be76d3e480c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afa524d499a94ac99b43c4eb855573a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:31Z,use_quota=True,user_id='dafe482390d947e9b7102d4e52ec81cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Creating volume bae1e4ce-0282-446b-b97c-9be76d3e480c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:36 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b038a9f-4769-4fad-a3dd-fcd12858aceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d408a816-502b-4db1-826f-4008526aacf9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a13ff0-83a2-4e87-80e1-019c992a74fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:36 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c 1073741824 Nov 06 19:53:36 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:36 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Volume volume-d408a816-502b-4db1-826f-4008526aacf9 (d408a816-502b-4db1-826f-4008526aacf9): created successfully Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a13ff0-83a2-4e87-80e1-019c992a74fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (59f21bd4-0ea6-461d-94a7-3c7dc5a815ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9d432330-303a-44b4-9545-4895f8f43d1b tempest-CreateVolumesFromImageTest-1664052976 None] Created volume successfully. Nov 06 19:53:36 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:36 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c 1073741824" returned: 0 in 0.435s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:36 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c Nov 06 19:53:36 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:36 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c" returned: 0 in 0.244s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.193s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-526739172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29591d4e-e04f-42ca-95f0-f0a23d5c8fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:33Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Creating volume 29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:36 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e798c1-55a7-4da4-abab-a557d46c4db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae1e4ce-0282-446b-b97c-9be76d3e480c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:36 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 1073741824 Nov 06 19:53:36 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60e3681-a4a3-4e87-9bbd-2748c02284a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:36 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Volume volume-bae1e4ce-0282-446b-b97c-9be76d3e480c (bae1e4ce-0282-446b-b97c-9be76d3e480c): created successfully Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60e3681-a4a3-4e87-9bbd-2748c02284a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Flow 'volume_create_manager' (b602758e-1822-44a9-97e3-958d50d73301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-661ddfd8-1e72-4a5b-a306-d330c2949864 tempest-CreateVolumesFromImageTest-1664052976 None] Created volume successfully. Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-bae1e4ce-0282-446b-b97c-9be76d3e480c-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-bae1e4ce-0282-446b-b97c-9be76d3e480c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-quobyte-bae1e4ce-0282-446b-b97c-9be76d3e480c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-bae1e4ce-0282-446b-b97c-9be76d3e480c" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e0a5a-5f46-4de7-8b33-1bf54a4e9009]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:37 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 1073741824" returned: 0 in 0.486s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:37 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 Nov 06 19:53:37 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:37 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c Nov 06 19:53:37 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:37 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.595s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775830058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c833b42-adce-448a-a50b-999ce3f9528c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:34Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Creating volume 1c833b42-adce-448a-a50b-999ce3f9528c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:37 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:37 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c" returned: 0 in 0.385s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:37 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c 1073741824 Nov 06 19:53:37 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed4e47e-a9e3-4440-91b9-dfc287eaf61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df93e56-55fd-4048-9038-b5e876d238e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:37 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c Nov 06 19:53:37 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 (29591d4e-e04f-42ca-95f0-f0a23d5c8fb5): created successfully Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df93e56-55fd-4048-9038-b5e876d238e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (395d16e4-33a9-4467-a10a-4beda3b260fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-26b129bf-2ccf-4531-967d-4f27722414f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created volume successfully. Nov 06 19:53:37 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-bae1e4ce-0282-446b-b97c-9be76d3e480c" returned: 0 in 0.257s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-bae1e4ce-0282-446b-b97c-9be76d3e480c" released by "delete_volume" :: held 0.689s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:37 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Created reservations ['c83856f0-19c2-4342-b1a2-0b6b57676081', '5bc8d624-9d17-4889-ad85-c69f9f52c5dc', 'ead1a654-2191-43e0-9628-9bfa1662d21f', '8f28a579-0de7-4fa4-92a0-8f44ff0e1a87'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:38 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:38 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:38 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c 1073741824" returned: 0 in 0.517s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:38 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c Nov 06 19:53:38 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:38 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.252s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Deleted volume successfully. Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-100d11b5-2256-4c29-8439-957fe7896e14 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-bae1e4ce-0282-446b-b97c-9be76d3e480c-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-d408a816-502b-4db1-826f-4008526aacf9-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-d408a816-502b-4db1-826f-4008526aacf9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-quobyte-d408a816-502b-4db1-826f-4008526aacf9" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-d408a816-502b-4db1-826f-4008526aacf9" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aeb4d2-00a4-489c-8683-64cb14037957]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:38 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c" returned: 0 in 0.288s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.978s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185393661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc1dedb-e0bb-453a-9230-f301991886af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:34Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Creating volume 7fc1dedb-e0bb-453a-9230-f301991886af {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:38 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de438a9-92c3-4230-a439-87d4c72dfd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c833b42-adce-448a-a50b-999ce3f9528c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7689070b-0055-473f-82ad-b4d50822f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:38 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af 1073741824 Nov 06 19:53:38 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:38 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume volume-1c833b42-adce-448a-a50b-999ce3f9528c (1c833b42-adce-448a-a50b-999ce3f9528c): created successfully Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7689070b-0055-473f-82ad-b4d50822f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (ada389b7-714a-4736-8905-76322f36bd25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:38 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-de675206-f903-4a95-9f46-ad36226bbccc tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created volume successfully. Nov 06 19:53:38 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 Nov 06 19:53:38 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:38 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9" returned: 0 in 0.386s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:38 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9 Nov 06 19:53:38 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:38 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af 1073741824" returned: 0 in 0.512s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:39 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af Nov 06 19:53:39 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:39 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d408a816-502b-4db1-826f-4008526aacf9" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-d408a816-502b-4db1-826f-4008526aacf9" released by "delete_volume" :: held 0.699s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Created reservations ['3dc137a1-ed9c-4d87-870c-9bf18eef3395', '9c95e9a7-7722-4933-8215-e581eee550ac', '6558dcba-3a75-4bea-b496-5390e8767497', '3a62777b-dc20-4de1-a3f1-5232b5df444d'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:39 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:39 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:39 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.202s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138578658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f289af-1b68-4de5-87fb-7dced86e3cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:35Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Creating volume b8f289af-1b68-4de5-87fb-7dced86e3cc8 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:39 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a919878d-0ec1-4998-b8ae-e8a951ec818c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc1dedb-e0bb-453a-9230-f301991886af', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6003b54d-7376-4c0f-a6b2-d4608d5e8968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:39 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 1073741824 Nov 06 19:53:39 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:39 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume volume-7fc1dedb-e0bb-453a-9230-f301991886af (7fc1dedb-e0bb-453a-9230-f301991886af): created successfully Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6003b54d-7376-4c0f-a6b2-d4608d5e8968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (3545bcc3-1967-45d9-a34d-eef1d5e45b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b86d65cd-758d-48b7-bf7a-dee60ba3df14 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created volume successfully. Nov 06 19:53:39 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:39 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Deleted volume successfully. Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-b872c865-33c3-4777-ab02-5cda36daafeb-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ad5999d7-808d-4560-8178-7ecaff26f0a6 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-d408a816-502b-4db1-826f-4008526aacf9-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-b872c865-33c3-4777-ab02-5cda36daafeb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-quobyte-b872c865-33c3-4777-ab02-5cda36daafeb" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-b872c865-33c3-4777-ab02-5cda36daafeb" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed4962a-e146-404f-b676-4051765af652]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:39 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb Nov 06 19:53:39 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:39 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 1073741824" returned: 0 in 0.530s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:39 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 Nov 06 19:53:39 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:40 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb" returned: 0 in 0.415s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:40 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb Nov 06 19:53:40 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:40 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8" returned: 0 in 0.266s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.382s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1495319104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632a828b-84cf-4484-93ca-b06171d7ca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0be0a1ef614fc3a56cb9eaee7888e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:36Z,use_quota=True,user_id='b841a7c5a9904d4da8a929fc57e64c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Creating volume 632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:40 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591d4fcc-7387-43e3-8a28-ce5f8d229cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:40 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 1073741824 Nov 06 19:53:40 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb126b3f-4953-4c10-92c7-9b98365582ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:40 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 (b8f289af-1b68-4de5-87fb-7dced86e3cc8): created successfully Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb126b3f-4953-4c10-92c7-9b98365582ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (e93553ef-d2ce-4226-9787-447c45763398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f611dcfc-c4f2-4e3c-b491-10826bb353c2 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created volume successfully. Nov 06 19:53:40 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b872c865-33c3-4777-ab02-5cda36daafeb" returned: 0 in 0.265s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-b872c865-33c3-4777-ab02-5cda36daafeb" released by "delete_volume" :: held 0.728s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Created reservations ['9cfaf617-c9b6-48c1-a72b-28eb53c74554', '20a99787-5653-436c-878b-49cf7d845006', '6e51c61f-c079-4985-8062-6e8594bfe8ae', '91a56161-21cc-4226-b87e-aaf3108a39d8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:40 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:40 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:40 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 1073741824" returned: 0 in 0.455s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:40 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 Nov 06 19:53:40 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-07780305-b604-4507-91dd-f5c9b38918ea-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:40 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Deleted volume successfully. Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-07780305-b604-4507-91dd-f5c9b38918ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-476b388a-062f-49f3-b8a2-59ecd4f6820a tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-b872c865-33c3-4777-ab02-5cda36daafeb-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-quobyte-07780305-b604-4507-91dd-f5c9b38918ea" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-07780305-b604-4507-91dd-f5c9b38918ea" acquired by "delete_volume" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6889467a-4752-437a-95f7-f971f0b798c0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:40 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01" returned: 0 in 0.289s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.957s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-257178835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111b7866-d07d-4c78-96cb-cf7081a76b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7da0032b384194a2f574847967742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:36Z,use_quota=True,user_id='d735c215ae28436f81606407f8164ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Creating volume 111b7866-d07d-4c78-96cb-cf7081a76b0e {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:40 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:40 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea Nov 06 19:53:40 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c802228-b909-47e6-a3ce-8d3b8174b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632a828b-84cf-4484-93ca-b06171d7ca01', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:40 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e 1073741824 Nov 06 19:53:40 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85130b89-9200-4f54-8e1b-068c36a25a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:40 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Volume volume-632a828b-84cf-4484-93ca-b06171d7ca01 (632a828b-84cf-4484-93ca-b06171d7ca01): created successfully Nov 06 19:53:40 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85130b89-9200-4f54-8e1b-068c36a25a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Flow 'volume_create_manager' (e18b53d7-e177-48f4-8fb6-49782d70723f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:41 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-65778ad2-6505-4c98-9853-f40711181ecc tempest-CinderUnicodeTest-1369687899 None] Created volume successfully. Nov 06 19:53:41 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:41 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea Nov 06 19:53:41 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:41 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e 1073741824" returned: 0 in 0.469s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:41 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e Nov 06 19:53:41 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:41 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-07780305-b604-4507-91dd-f5c9b38918ea" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-07780305-b604-4507-91dd-f5c9b38918ea" released by "delete_volume" :: held 0.727s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Created reservations ['21c57a81-658e-4cd5-804a-b02c2f30f427', 'd600714f-1e27-45db-9d12-00724c56f519', '15e8517c-09e1-41c1-a429-3a2deff72455', '23d38034-368c-4550-9d80-093b313c1a9f'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:41 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:41 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:41 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.534s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d695c684-23a1-476b-bab8-c8138014425f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532eda2f20534aab853a6c01283a8d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:34Z,use_quota=True,user_id='e600ff7e784d46a49a718462e156b9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9026af9d-6250-48c3-b9d8-42aea18e81a0),volume_type_id=9026af9d-6250-48c3-b9d8-42aea18e81a0)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Creating volume d695c684-23a1-476b-bab8-c8138014425f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:41 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:41 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f 1073741824 Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f684aff3-cd11-489b-8096-f98716cc6a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111b7866-d07d-4c78-96cb-cf7081a76b0e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:41 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340ddbe0-b563-426e-a19b-c57abfe47831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:41 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Volume volume-111b7866-d07d-4c78-96cb-cf7081a76b0e (111b7866-d07d-4c78-96cb-cf7081a76b0e): created successfully Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340ddbe0-b563-426e-a19b-c57abfe47831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Flow 'volume_create_manager' (cdb25c27-5f98-45ea-8370-8f17222be1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:41 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-50c03271-b556-4c13-b7f6-968b66a28d48 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created volume successfully. Nov 06 19:53:41 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-66d06b46-af3e-470c-a1b3-edec94c15bb0-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:41 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Deleted volume successfully. Nov 06 19:53:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-66d06b46-af3e-470c-a1b3-edec94c15bb0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4af8c289-f1af-4d9f-b82c-9655806e314e tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-07780305-b604-4507-91dd-f5c9b38918ea-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "cinder-quobyte-66d06b46-af3e-470c-a1b3-edec94c15bb0" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-66d06b46-af3e-470c-a1b3-edec94c15bb0" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a144eb59-795d-40af-8e95-577d32fcd87d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:42 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 Nov 06 19:53:42 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:42 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f 1073741824" returned: 0 in 0.595s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:42 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f Nov 06 19:53:42 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-111b7866-d07d-4c78-96cb-cf7081a76b0e-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-111b7866-d07d-4c78-96cb-cf7081a76b0e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-quobyte-111b7866-d07d-4c78-96cb-cf7081a76b0e" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-111b7866-d07d-4c78-96cb-cf7081a76b0e" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03d11f-44ce-496b-b45c-a6aa1bb4eca8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:42 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0" returned: 0 in 0.452s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:42 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0 Nov 06 19:53:42 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:42 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e Nov 06 19:53:42 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:42 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.457s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Creating offline snapshot 62b23021-578d-4c97-9c04-a28d85441bd4 of volume 632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Attempting download of d55bf66a-b24f-4e7a-93a9-2e99ceaa640c ((None, [{'url': 'file:///opt/stack/data/glance/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'metadata': {}}])) to volume d695c684-23a1-476b-bab8-c8138014425f. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6424ace-0f42-4bb0-b765-a25a7cf46467]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd508f67-0156-4da5-a7fa-7b4d803450c5]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c_qoz_rn16 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:42 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 Nov 06 19:53:42 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:42 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-66d06b46-af3e-470c-a1b3-edec94c15bb0" returned: 0 in 0.286s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-quobyte-66d06b46-af3e-470c-a1b3-edec94c15bb0" released by "delete_volume" :: held 0.799s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:42 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c_qoz_rn16 Nov 06 19:53:42 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:42 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e" returned: 0 in 0.419s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:42 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Created reservations ['beac45d6-64bf-4a77-ac04-a924fe50481d', 'd06b23de-89e7-49b2-a553-d9319363bd56', '9ffb2435-0412-44db-9a2a-03577e7b37c0', '01864bc0-01b5-4c11-a42e-4c57c5d75067'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:42 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e Nov 06 19:53:42 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:43 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:43 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:43 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01" returned: 0 in 0.449s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:43 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 1G Nov 06 19:53:43 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:43 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c_qoz_rn16" returned: 0 in 0.441s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c_qoz_rn16 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:43 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-111b7866-d07d-4c78-96cb-cf7081a76b0e" returned: 0 in 0.391s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-111b7866-d07d-4c78-96cb-cf7081a76b0e" released by "delete_volume" :: held 0.876s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:43 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c_qoz_rn16 Nov 06 19:53:43 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:43 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.369s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Deleted volume successfully. Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created reservations ['672336b0-7790-43ed-83fb-94767a9e65b0', 'def852ee-e203-452f-80e7-5bb561a8d3ac', '2a3506c8-6c7e-4267-91ea-5737b1f7c1ff', '20d1a0fb-6fc0-4625-81a6-911d078301b5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-5d7f75c0-20a5-445c-9987-e656c9278360 tempest-CreateVolumesFromImageTest-1664052976 None] Lock "cinder-66d06b46-af3e-470c-a1b3-edec94c15bb0-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:43 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:43 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-b8f289af-1b68-4de5-87fb-7dced86e3cc8-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-b8f289af-1b68-4de5-87fb-7dced86e3cc8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:43 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c_qoz_rn16" returned: 1 in 0.460s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c_qoz_rn16' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6024d719-ca2e-4e3a-a5e0-d48593b56be4]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-quobyte-b8f289af-1b68-4de5-87fb-7dced86e3cc8" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-b8f289af-1b68-4de5-87fb-7dced86e3cc8" acquired by "delete_volume" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:43 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 1G" returned: 0 in 0.647s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632a828b-84cf-4484-93ca-b06171d7ca01 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1d835-f2f2-43ba-bb77-5fa57bcff819]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:43 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632a828b-84cf-4484-93ca-b06171d7ca01 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 Nov 06 19:53:43 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:43 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD Nov 06 19:53:43 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:43 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.347s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Deleted volume successfully. Nov 06 19:53:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-7127f30a-ebff-4841-886f-3fa227ba8856 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-111b7866-d07d-4c78-96cb-cf7081a76b0e-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:43 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 Nov 06 19:53:43 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:44 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:44 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632a828b-84cf-4484-93ca-b06171d7ca01 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4" returned: 0 in 0.414s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:44 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 is being set with open permissions: ugo+rw Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:44 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 Nov 06 19:53:44 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:44 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD Nov 06 19:53:44 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:44 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8" returned: 0 in 0.519s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:44 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8 Nov 06 19:53:44 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:44 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4" returned: 0 in 0.362s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:44 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] d55bf66a-b24f-4e7a-93a9-2e99ceaa640c was raw, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:44 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f Nov 06 19:53:44 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:44 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.info Nov 06 19:53:44 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:44 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b8f289af-1b68-4de5-87fb-7dced86e3cc8" returned: 0 in 0.346s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-b8f289af-1b68-4de5-87fb-7dced86e3cc8" released by "delete_volume" :: held 0.952s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created reservations ['9ab1ae05-eb45-423c-afc5-59804860a695', '2b9990eb-6f19-411d-905c-90ed2d87ea68', '3ae2bc6c-7b24-4e5f-a4c2-c6646e588afe', '4b6202cc-60b2-46a7-9083-ba0469188d5d'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:44 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:44 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:44 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.info" returned: 0 in 0.324s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:44 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.info is being set with open permissions: ugo+rw Nov 06 19:53:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:45 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.info Nov 06 19:53:45 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:45 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:45 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.343s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f" returned: 0 in 0.606s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d55bf66a-b24f-4e7a-93a9-2e99ceaa640c__bqe1gdndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:53:45 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Deleted volume successfully. Nov 06 19:53:45 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f 1G Nov 06 19:53:45 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a3543517-3da0-4479-b40f-4989959587f6 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-b8f289af-1b68-4de5-87fb-7dced86e3cc8-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:45 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.info" returned: 0 in 0.410s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-39859b55-b8e3-4d23-8ee6-63f6bb7c5f04 tempest-CinderUnicodeTest-1369687899 None] Create snapshot completed successfully Nov 06 19:53:45 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f 1G" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Downloaded image d55bf66a-b24f-4e7a-93a9-2e99ceaa640c ((None, [{'url': 'file:///opt/stack/data/glance/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'metadata': {}}])) to volume d695c684-23a1-476b-bab8-c8138014425f successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Temporary image d55bf66a-b24f-4e7a-93a9-2e99ceaa640c for user e600ff7e784d46a49a718462e156b9cc is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Marking volume d695c684-23a1-476b-bab8-c8138014425f as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Copying metadata from image d55bf66a-b24f-4e7a-93a9-2e99ceaa640c to d695c684-23a1-476b-bab8-c8138014425f. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Creating volume glance metadata for volume d695c684-23a1-476b-bab8-c8138014425f backed by image d55bf66a-b24f-4e7a-93a9-2e99ceaa640c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e072058201e1a389b70062e7e9d39b2b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bfc6aa-5bd8-404f-9f4a-f03b5932a27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d695c684-23a1-476b-bab8-c8138014425f', 'volume_size': 1, 'image_id': 'd55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e072058201e1a389b70062e7e9d39b2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '532eda2f20534aab853a6c01283a8d89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '790d1d3d6009bb3ab3b0c4dcb514a4eff1428298ce4752b8e6ec5e29648acefddd5ec78913087f74b35008b38f91406b5b749eabf22868e9356b9ff73b8d7d3f', 'id': 'd55bf66a-b24f-4e7a-93a9-2e99ceaa640c', 'created_at': datetime.datetime(2026, 11, 6, 18, 53, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 53, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d55bf66a-b24f-4e7a-93a9-2e99ceaa640c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e15722-d2b3-4884-b2e7-5290f509e5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:45 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Volume volume-d695c684-23a1-476b-bab8-c8138014425f (d695c684-23a1-476b-bab8-c8138014425f): created successfully Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e15722-d2b3-4884-b2e7-5290f509e5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Flow 'volume_create_manager' (436becb3-fe31-489e-9d19-96b3000724ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ae07befa-379c-41f7-a539-e9d64069748b tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Created volume successfully. Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-7fc1dedb-e0bb-453a-9230-f301991886af-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-7fc1dedb-e0bb-453a-9230-f301991886af-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-quobyte-7fc1dedb-e0bb-453a-9230-f301991886af" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-7fc1dedb-e0bb-453a-9230-f301991886af" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc42bf93-6488-415d-8dfb-1e8378350935]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:46 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af Nov 06 19:53:46 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:46 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af" returned: 0 in 0.396s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "cinder-62b23021-578d-4c97-9c04-a28d85441bd4-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:46 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af Nov 06 19:53:46 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-62b23021-578d-4c97-9c04-a28d85441bd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "cinder-quobyte-632a828b-84cf-4484-93ca-b06171d7ca01" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-632a828b-84cf-4484-93ca-b06171d7ca01" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "cinder-quobyte-62b23021-578d-4c97-9c04-a28d85441bd4" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-62b23021-578d-4c97-9c04-a28d85441bd4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Deleting offline snapshot 62b23021-578d-4c97-9c04-a28d85441bd4 of volume 632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] snapshot_file for this snap is: volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51a7444-89d8-4d7f-8a8d-a3eae7bdc7a8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Acquiring lock "cinder-d695c684-23a1-476b-bab8-c8138014425f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "cinder-d695c684-23a1-476b-bab8-c8138014425f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:46 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 Nov 06 19:53:46 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Acquiring lock "cinder-quobyte-d695c684-23a1-476b-bab8-c8138014425f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "cinder-quobyte-d695c684-23a1-476b-bab8-c8138014425f" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:46 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fc1dedb-e0bb-453a-9230-f301991886af" returned: 0 in 0.356s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[826b3bf7-ec2e-41f2-964a-d27695245102]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-7fc1dedb-e0bb-453a-9230-f301991886af" released by "delete_volume" :: held 0.813s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created reservations ['b42061b3-d521-417b-9457-1a3e2430cda5', 'b9f32e69-a509-424e-9b27-6259b3f8db9f', 'b26f2db2-a2b4-4ce2-b117-2a9745066a5a', '97704a00-6c4c-45c4-8b9c-08031219a94c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:46 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:46 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:47 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (3b99fc00-f183-4a41-9307-ce571d1579ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27198a29-9d15-4053-9238-c665c4afbd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:47 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-1c833b42-adce-448a-a50b-999ce3f9528c-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:47 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:47 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4" returned: 0 in 0.622s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632a828b-84cf-4484-93ca-b06171d7ca01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27198a29-9d15-4053-9238-c665c4afbd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1322149776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:47Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba021c9-f6dd-4b08-9663-1e1270759aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba021c9-f6dd-4b08-9663-1e1270759aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f254442e-15ee-4d4a-93ba-1d30347f83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f254442e-15ee-4d4a-93ba-1d30347f83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94', 'volume_name': 'volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4babf4e4-b879-4511-a366-5f6c45277a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4babf4e4-b879-4511-a366-5f6c45277a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498e2c74-7287-400e-9759-82ffbef9ce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:47 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94', 'volume_size': 1} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1322149776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:47Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Creating volume b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:47 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-1c833b42-adce-448a-a50b-999ce3f9528c-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682fca4-313b-486e-a0ae-dda9b93cbd46]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:47 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 1073741824 Nov 06 19:53:47 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.382s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f" returned: 0 in 0.548s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Deleted volume successfully. Nov 06 19:53:47 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f Nov 06 19:53:47 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-8cf47476-0738-4ce1-8fe2-7e5f14002a84 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-7fc1dedb-e0bb-453a-9230-f301991886af-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-quobyte-1c833b42-adce-448a-a50b-999ce3f9528c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:47 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 Nov 06 19:53:47 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-1c833b42-adce-448a-a50b-999ce3f9528c" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd4126-2f13-4eb5-b5bb-61dee4bc733b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.364s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:53:47 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c Nov 06 19:53:47 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:47 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01" returned: 0 in 0.409s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d695c684-23a1-476b-bab8-c8138014425f" returned: 0 in 0.396s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 Nov 06 19:53:47 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "cinder-quobyte-d695c684-23a1-476b-bab8-c8138014425f" released by "delete_volume" :: held 1.009s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Created reservations ['d2b72fed-8552-4d7c-b602-689201386ca4', '1d185228-6418-4486-96ac-32cfef5eeeea', 'c2129903-605d-49f4-bf5e-cba67aa3fc01', '0149ac41-59a5-4c57-8fdf-77e9af70aebb'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:47 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 1073741824" returned: 0 in 0.668s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c" returned: 0 in 0.473s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:48 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:48 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:48 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c Nov 06 19:53:48 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:48 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 Nov 06 19:53:48 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:48 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4" returned: 0 in 0.464s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:48 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4 Nov 06 19:53:48 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:48 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.306s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Deleted volume successfully. Nov 06 19:53:48 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1c833b42-adce-448a-a50b-999ce3f9528c" returned: 0 in 0.302s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-1c833b42-adce-448a-a50b-999ce3f9528c" released by "delete_volume" :: held 0.837s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f8bb72aa-011f-429f-bc4b-613db5d866ee tempest-VolumeAndVolumeTypeFromImageTest-529380083 None] Lock "cinder-d695c684-23a1-476b-bab8-c8138014425f-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:48 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" returned: 0 in 0.309s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498e2c74-7287-400e-9759-82ffbef9ce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b95b837-35dc-4874-ab77-f8951c3c88d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:48 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 (b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94): created successfully Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b95b837-35dc-4874-ab77-f8951c3c88d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (3b99fc00-f183-4a41-9307-ce571d1579ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-63109af9-fb80-41a2-8b95-c2d46595f680 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created volume successfully. Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created reservations ['8b3ff383-dc59-4333-a35a-76ce2e44f534', 'd33e5a91-8a41-4e28-9107-811bca9b2126', '75f4f2e0-95f8-4479-a9bf-e0b54e62678f', '70c0c372-84fc-4266-a32a-75401c0ac945'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:48 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01.62b23021-578d-4c97-9c04-a28d85441bd4" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:48 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:48 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-62b23021-578d-4c97-9c04-a28d85441bd4" released by "_delete_snapshot" :: held 2.008s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-632a828b-84cf-4484-93ca-b06171d7ca01" released by "delete_snapshot" :: held 2.036s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Created reservations ['d99b01b0-c1c1-42b0-b4fb-3f1eed3077ef', '36bb6f27-337f-41b0-a840-50fdfea4e076', 'b6c4eb8b-a969-48bc-b1e6-880ae1035b3f', '1b8ccdc3-d847-4cc2-b9c8-8dc8918010dd'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Delete snapshot completed successfully. Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-75b34a8b-b5eb-4e89-9b89-309e3b6f3751 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-62b23021-578d-4c97-9c04-a28d85441bd4-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:48 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.249s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Deleted volume successfully. Nov 06 19:53:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b6745c5e-ffd3-47b1-af47-4204b251e490 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-1c833b42-adce-448a-a50b-999ce3f9528c-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Creating offline snapshot 55579912-6dd4-474e-ad8e-49fee65d3d92 of volume b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1ec1e-e43d-4f5a-b683-5a148042e17f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-quobyte-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa7bc0e-c045-4aac-bd99-a04d051b9d65]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:49 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 Nov 06 19:53:49 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "cinder-632a828b-84cf-4484-93ca-b06171d7ca01-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:49 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 Nov 06 19:53:49 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-632a828b-84cf-4484-93ca-b06171d7ca01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "cinder-quobyte-632a828b-84cf-4484-93ca-b06171d7ca01" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-632a828b-84cf-4484-93ca-b06171d7ca01" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8449a-85ac-4bb6-b416-86ec503dc7f1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:50 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 Nov 06 19:53:50 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:50 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5" returned: 0 in 0.487s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:50 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" returned: 0 in 0.682s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:50 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5 Nov 06 19:53:50 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:50 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 1G Nov 06 19:53:50 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:50 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01" returned: 0 in 0.531s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:50 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01 Nov 06 19:53:50 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:50 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5" returned: 0 in 0.450s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5" released by "delete_volume" :: held 1.015s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created reservations ['6320e29d-5379-484a-ab24-8ac96f2c9ac0', '5d1db92a-3ea6-442f-9a57-d3af5e56a443', '9859f356-06b2-49dc-8d2b-4d9afd50ec60', 'ced4b61a-f763-45ec-a595-8d7a1989e08e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:50 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 1G" returned: 0 in 0.581s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:50 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 Nov 06 19:53:50 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:50 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:50 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:50 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-632a828b-84cf-4484-93ca-b06171d7ca01" returned: 0 in 0.422s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-632a828b-84cf-4484-93ca-b06171d7ca01" released by "delete_volume" :: held 1.073s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Created reservations ['81ab2010-eda3-4214-bf26-0904f318a537', '8d441913-f189-48e9-8399-41362a30c06a', '5f14118b-10cd-47ac-8437-ad5b197e573b', '256dbae2-232d-4be5-9a38-8c739bf30094'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:51 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.324s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:51 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92" returned: 0 in 0.406s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:51 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 is being set with open permissions: ugo+rw Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:51 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:51 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Deleted volume successfully. Nov 06 19:53:51 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 Nov 06 19:53:51 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b8afad2b-5969-4445-b9b6-ac67106d0664 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-29591d4e-e04f-42ca-95f0-f0a23d5c8fb5-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:51 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.344s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:51 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Deleted volume successfully. Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92" returned: 0 in 0.320s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-50e1c10d-c0bd-48f4-a898-9a982eb93d88 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-632a828b-84cf-4484-93ca-b06171d7ca01-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:51 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.info Nov 06 19:53:51 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:51 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.info" returned: 0 in 0.308s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:51 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.info is being set with open permissions: ugo+rw Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-8cdcb802-172c-4fcc-bd32-9362a01929d8-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:51 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.info Nov 06 19:53:51 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-8cdcb802-172c-4fcc-bd32-9362a01929d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "cinder-quobyte-8cdcb802-172c-4fcc-bd32-9362a01929d8" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-8cdcb802-172c-4fcc-bd32-9362a01929d8" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[409ab81a-58f3-457a-a942-11bbf2d9ace3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "cinder-168d1ada-772d-4930-89c2-ba79728fb3f6-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-168d1ada-772d-4930-89c2-ba79728fb3f6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "cinder-quobyte-168d1ada-772d-4930-89c2-ba79728fb3f6" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-168d1ada-772d-4930-89c2-ba79728fb3f6" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:52 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.info" returned: 0 in 0.348s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc6263d-6993-430e-b4fc-c578623c6203]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:52 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 Nov 06 19:53:52 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6d165e7d-ee6e-4479-8a2b-329432ac3b71 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Create snapshot completed successfully Nov 06 19:53:52 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 Nov 06 19:53:52 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:52 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8" returned: 0 in 0.514s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:52 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8 Nov 06 19:53:52 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:52 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6" returned: 0 in 0.478s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:52 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6 Nov 06 19:53:52 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:52 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-8cdcb802-172c-4fcc-bd32-9362a01929d8" returned: 0 in 0.338s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-quobyte-8cdcb802-172c-4fcc-bd32-9362a01929d8" released by "delete_volume" :: held 0.922s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:52 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Created reservations ['21cde011-7979-4092-98f5-84ff80e81b40', '408d1e74-d022-441d-9b9b-d8dd0cbec860', '81c5f881-f36b-4fae-8116-49760269604b', '45ff0f7a-9029-43a9-a900-5cc2fc9fbf78'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:53 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-168d1ada-772d-4930-89c2-ba79728fb3f6" returned: 0 in 0.372s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-quobyte-168d1ada-772d-4930-89c2-ba79728fb3f6" released by "delete_volume" :: held 0.934s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:53 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:53 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Created reservations ['590748ed-5421-4099-abd7-bc8e843e1285', '7136bea7-f540-4454-a9ed-a2b4f72c9158', 'ab722a17-30e7-4cd7-991b-5a20006ab44a', '4584c763-4fd2-45c3-8460-7f4b429e1d63'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (572b3bda-2858-4364-b1de-02755c822371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86819fb5-00c5-4cf8-9e66-d74d623d9064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86819fb5-00c5-4cf8-9e66-d74d623d9064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1077202860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd82ceb-f69b-47b6-a7b7-c31d165e9953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:53Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab7ce2a-6654-4a86-bc97-84cf4efcae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab7ce2a-6654-4a86-bc97-84cf4efcae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543ad38f-78f0-4ba1-81d0-eb3421c697f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:53:53 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543ad38f-78f0-4ba1-81d0-eb3421c697f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd82ceb-f69b-47b6-a7b7-c31d165e9953', 'volume_name': 'volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7c15ca-7e3c-445f-99ff-70e9f8e72ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7c15ca-7e3c-445f-99ff-70e9f8e72ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa354f8-fa47-4d8c-b13b-133e3329f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume 7fd82ceb-f69b-47b6-a7b7-c31d165e9953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953', 'volume_size': 1} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1077202860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd82ceb-f69b-47b6-a7b7-c31d165e9953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:53Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Creating volume 7fd82ceb-f69b-47b6-a7b7-c31d165e9953 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:53 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:53 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 1073741824 Nov 06 19:53:53 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:53 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.455s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Deleted volume successfully. Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-3895ff58-d393-4968-91df-0baadf583971 tempest-CreateVolumesFromSourceVolumeTest-1276541987 None] Lock "cinder-8cdcb802-172c-4fcc-bd32-9362a01929d8-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:53 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.343s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:53:53 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Deleted volume successfully. Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f5c2bbac-c3ec-4d68-9af1-925d82fc3039 tempest-CinderUnicodeTest-1369687899 None] Lock "cinder-168d1ada-772d-4930-89c2-ba79728fb3f6-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (5fee0baf-a56e-4bee-a133-6b58b96b3c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ccb5e6-0023-4663-9279-21489ccd7973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ccb5e6-0023-4663-9279-21489ccd7973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1065207740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1daa7fe-9dff-4caf-a865-0058598611a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:54Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2647817b-d0a6-405b-833c-f71626948861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2647817b-d0a6-405b-833c-f71626948861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0336f51-bbb7-46be-b54f-962e208438e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0336f51-bbb7-46be-b54f-962e208438e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1daa7fe-9dff-4caf-a865-0058598611a1', 'volume_name': 'volume-d1daa7fe-9dff-4caf-a865-0058598611a1', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18fc444-721f-4004-99fb-2b26be85c894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18fc444-721f-4004-99fb-2b26be85c894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a56deb-4d90-43de-8ace-3154b0495dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume d1daa7fe-9dff-4caf-a865-0058598611a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1daa7fe-9dff-4caf-a865-0058598611a1', 'volume_size': 1} Nov 06 19:53:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:54 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 1073741824" returned: 0 in 0.626s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:54 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 Nov 06 19:53:54 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (f76b6209-c09f-46e4-8f9b-9328ce471e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e64b51-90a6-4150-b849-02b918c7fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e64b51-90a6-4150-b849-02b918c7fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604051422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53624e0-0d36-485b-8ab1-5aca3618b3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:54Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:54 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d88149e-0f2c-488d-ba86-c51f1279df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d88149e-0f2c-488d-ba86-c51f1279df30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76c9086-9104-450b-95e4-84f1c9d0f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76c9086-9104-450b-95e4-84f1c9d0f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c53624e0-0d36-485b-8ab1-5aca3618b3f4', 'volume_name': 'volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a100dbab-d1ec-4fee-a505-4a6a21ab9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a100dbab-d1ec-4fee-a505-4a6a21ab9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd5cf9a-a872-4a91-9ddd-545b7054e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:54 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume c53624e0-0d36-485b-8ab1-5aca3618b3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4', 'volume_size': 1} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953" returned: 0 in 0.475s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1065207740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1daa7fe-9dff-4caf-a865-0058598611a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:54Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Creating volume d1daa7fe-9dff-4caf-a865-0058598611a1 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:54 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:54 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 1073741824 Nov 06 19:53:54 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa354f8-fa47-4d8c-b13b-133e3329f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8b2faf-d781-4e01-b426-b8f7a2855280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:54 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 (7fd82ceb-f69b-47b6-a7b7-c31d165e9953): created successfully Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8b2faf-d781-4e01-b426-b8f7a2855280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (572b3bda-2858-4364-b1de-02755c822371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3c20b3e3-a406-488c-8925-d49f99669e21 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created volume successfully. Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (e95d1f9d-1d24-46f3-a874-91a785aafb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1542bd-bd76-4995-a2c5-03850c0bbae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:54 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1542bd-bd76-4995-a2c5-03850c0bbae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-403319567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997183e9-7a7b-4019-83b3-b857dec6df1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:55Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8b13b-e0b9-43cf-a3cc-abef237e5618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8b13b-e0b9-43cf-a3cc-abef237e5618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce90441-00fc-4a87-a8b6-68d1faf2e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce90441-00fc-4a87-a8b6-68d1faf2e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997183e9-7a7b-4019-83b3-b857dec6df1e', 'volume_name': 'volume-997183e9-7a7b-4019-83b3-b857dec6df1e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85d9d7d-985d-4050-8842-1481456b592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85d9d7d-985d-4050-8842-1481456b592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bc4c75-0b93-4e35-9092-d5709cdc0c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume 997183e9-7a7b-4019-83b3-b857dec6df1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997183e9-7a7b-4019-83b3-b857dec6df1e', 'volume_size': 1} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (a3089e56-4798-4d55-badd-1da00a472910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a097ed9e-9dad-4062-a388-36a3dae0b4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a097ed9e-9dad-4062-a388-36a3dae0b4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1316955467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e446efe-d2c0-424c-b09f-2e030cb6ec78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:55Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb774e-75f4-42ee-be50-284a8a6ddae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdb774e-75f4-42ee-be50-284a8a6ddae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c532c10d-146e-4c7f-89dd-de9a02d1996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c532c10d-146e-4c7f-89dd-de9a02d1996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e446efe-d2c0-424c-b09f-2e030cb6ec78', 'volume_name': 'volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2900a766-ca11-4d3e-b50e-6aa8181ff5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2900a766-ca11-4d3e-b50e-6aa8181ff5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ffa7cf-e95d-45ae-8bad-050c730b7e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume 1e446efe-d2c0-424c-b09f-2e030cb6ec78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78', 'volume_size': 1} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:55 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 1073741824" returned: 0 in 0.837s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:55 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 Nov 06 19:53:55 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:55 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1" returned: 0 in 0.323s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604051422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53624e0-0d36-485b-8ab1-5aca3618b3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:54Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Creating volume c53624e0-0d36-485b-8ab1-5aca3618b3f4 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:55 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:55 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 1073741824 Nov 06 19:53:55 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a56deb-4d90-43de-8ace-3154b0495dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1daa7fe-9dff-4caf-a865-0058598611a1', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4729ace1-340a-429e-b59b-db3bc35c2fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:55 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume volume-d1daa7fe-9dff-4caf-a865-0058598611a1 (d1daa7fe-9dff-4caf-a865-0058598611a1): created successfully Nov 06 19:53:55 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4729ace1-340a-429e-b59b-db3bc35c2fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (5fee0baf-a56e-4bee-a133-6b58b96b3c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ca859ed4-b878-44e1-b106-96b47265a524 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created volume successfully. Nov 06 19:53:56 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 1073741824" returned: 0 in 0.784s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:56 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 Nov 06 19:53:56 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:56 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.901s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-403319567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997183e9-7a7b-4019-83b3-b857dec6df1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:55Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Creating volume 997183e9-7a7b-4019-83b3-b857dec6df1e {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:56 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd5cf9a-a872-4a91-9ddd-545b7054e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbea7f90-0fdb-4457-b5ba-ab4724469edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:57 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e 1073741824 Nov 06 19:53:57 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:57 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 (c53624e0-0d36-485b-8ab1-5aca3618b3f4): created successfully Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbea7f90-0fdb-4457-b5ba-ab4724469edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (f76b6209-c09f-46e4-8f9b-9328ce471e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:57 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-dca71d99-144d-42f0-be3d-54d7628daa79 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created volume successfully. Nov 06 19:53:57 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e 1073741824" returned: 0 in 0.511s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:57 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e Nov 06 19:53:57 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:57 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.426s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1316955467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e446efe-d2c0-424c-b09f-2e030cb6ec78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9808bbd8c2794e819746aa0b362cc0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:55Z,use_quota=True,user_id='9ae15abd21eb4433b73b41dad452dd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Creating volume 1e446efe-d2c0-424c-b09f-2e030cb6ec78 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:57 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bc4c75-0b93-4e35-9092-d5709cdc0c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997183e9-7a7b-4019-83b3-b857dec6df1e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b724ab-807e-4c31-b23c-448f29051e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:57 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 1073741824 Nov 06 19:53:57 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:57 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume volume-997183e9-7a7b-4019-83b3-b857dec6df1e (997183e9-7a7b-4019-83b3-b857dec6df1e): created successfully Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b724ab-807e-4c31-b23c-448f29051e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:57 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (e95d1f9d-1d24-46f3-a874-91a785aafb3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:57 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4d5617ea-c3ae-4a2a-846f-d2ad813e834d tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created volume successfully. Nov 06 19:53:58 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 1073741824" returned: 0 in 0.582s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:58 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 Nov 06 19:53:58 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:58 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78" returned: 0 in 0.259s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ffa7cf-e95d-45ae-8bad-050c730b7e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c39acc-f1c5-4f6d-bb61-e3f31bdc96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:58 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Volume volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 (1e446efe-d2c0-424c-b09f-2e030cb6ec78): created successfully Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c39acc-f1c5-4f6d-bb61-e3f31bdc96da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Flow 'volume_create_manager' (a3089e56-4798-4d55-badd-1da00a472910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2dbb218d-082b-4112-851f-980568ce8f16 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created volume successfully. Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Flow 'volume_create_manager' (d4584450-3eae-4f75-9545-d09dcd56a38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e63a86-e40e-4a78-a81a-70b33214592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-1e446efe-d2c0-424c-b09f-2e030cb6ec78-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e63a86-e40e-4a78-a81a-70b33214592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a007a09-399c-48fa-9e76-35ebd98a331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83682e05210f4c93a857567e63755058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:59Z,use_quota=True,user_id='c87a674b4d294ef9a2e2f9c09f8a5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7a0ef1-f5a9-4157-ad85-ecab89e656d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7a0ef1-f5a9-4157-ad85-ecab89e656d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e6a34e-b8fe-4a34-9bd7-fc38e9e07cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.image.glance [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Creating Keystone auth plugin from conf {{(pid=86928) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-1e446efe-d2c0-424c-b09f-2e030cb6ec78-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-1e446efe-d2c0-424c-b09f-2e030cb6ec78" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-1e446efe-d2c0-424c-b09f-2e030cb6ec78" acquired by "delete_volume" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c135f975-f607-4ba0-a734-286ea8c8197f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Flow 'volume_create_manager' (7dd61015-9a75-4085-9d7c-1e6daa3f3a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beb1c94-db18-46a3-9960-430ecc79dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beb1c94-db18-46a3-9960-430ecc79dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1904207743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea72228-664e-401b-9341-78f47930c0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8485a55b7abb47d8a02ff3603a596c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:59Z,use_quota=True,user_id='b9c9a86962364f90af06273e2ddf3a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53450200-ee7a-4f02-920d-0c98805f983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53450200-ee7a-4f02-920d-0c98805f983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c937643-8425-4a67-acbc-1a1b0ea5c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c937643-8425-4a67-acbc-1a1b0ea5c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea72228-664e-401b-9341-78f47930c0c9', 'volume_name': 'volume-0ea72228-664e-401b-9341-78f47930c0c9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d99d924-3ac4-4719-b53a-a8e3f4df4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d99d924-3ac4-4719-b53a-a8e3f4df4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30fd7b8-2817-4b04-95cd-555a862ed51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Volume 0ea72228-664e-401b-9341-78f47930c0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea72228-664e-401b-9341-78f47930c0c9', 'volume_size': 1} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1904207743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea72228-664e-401b-9341-78f47930c0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8485a55b7abb47d8a02ff3603a596c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:59Z,use_quota=True,user_id='b9c9a86962364f90af06273e2ddf3a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Creating volume 0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:53:59 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:53:59 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:53:59 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:59 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 1073741824 Nov 06 19:53:59 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-118d2ce0-3c9e-4ffd-866d-191f3334e5b0 tempest-ProjectAdminTests-1669526368 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8011436462402, 'free_capacity_gb': 1773.8011436462402, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86928) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e6a34e-b8fe-4a34-9bd7-fc38e9e07cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a007a09-399c-48fa-9e76-35ebd98a331b', 'volume_name': 'volume-1a007a09-399c-48fa-9e76-35ebd98a331b', 'volume_size': 1, 'image_id': 'e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44d80a1d1d98eef5e99ba9a7f8b961a9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '83682e05210f4c93a857567e63755058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6d247e6e87e834c6ca75b855856c3ceeb5f13adcc6a61920849f26298a37474c3a880cd41668ec5d293400c0aa3c471289b59de193d2d48c03aedc0119aa2b5', 'id': 'e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'created_at': datetime.datetime(2026, 11, 6, 18, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1/file', 'properties': {}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb60329-66fa-442e-9e71-9414682a4612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb60329-66fa-442e-9e71-9414682a4612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1d15d8-30bd-4b29-b55f-befeac44d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:53:59 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Volume 1a007a09-399c-48fa-9e76-35ebd98a331b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a007a09-399c-48fa-9e76-35ebd98a331b', 'volume_size': 1, 'image_id': 'e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44d80a1d1d98eef5e99ba9a7f8b961a9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '83682e05210f4c93a857567e63755058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6d247e6e87e834c6ca75b855856c3ceeb5f13adcc6a61920849f26298a37474c3a880cd41668ec5d293400c0aa3c471289b59de193d2d48c03aedc0119aa2b5', 'id': 'e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'created_at': datetime.datetime(2026, 11, 6, 18, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1/file', 'properties': {}}, 'image_service': } Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Trying to clone 1a007a09-399c-48fa-9e76-35ebd98a331b from image e5ecfed6-93f7-46ff-b00b-abb684ede4e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'metadata': {}}]). {{(pid=86928) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 19:53:59 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78" returned: 0 in 0.438s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:53:59 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78 Nov 06 19:53:59 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:53:59 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 19:53:59 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Image download 0.00 MB at 0.00 MB/s Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5947186a-a159-4ec4-91ee-eb04935d38c9]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:00 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 1073741824" returned: 0 in 0.579s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:00 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD Nov 06 19:54:00 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:00 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1e446efe-d2c0-424c-b09f-2e030cb6ec78" returned: 0 in 0.330s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-1e446efe-d2c0-424c-b09f-2e030cb6ec78" released by "delete_volume" :: held 0.835s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:00 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 Nov 06 19:54:00 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created reservations ['66f241eb-cf93-44bd-99d1-3ecf50060a6f', '3c2d6b88-2dfb-476b-bbb6-ceddac5c6641', 'aef0b4bb-3ec4-43fb-b979-595ee368fd7c', '8d038e92-1151-4e82-9d74-7d30366ab0cf'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:00 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:00 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9" returned: 0 in 0.317s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:00 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:00 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30fd7b8-2817-4b04-95cd-555a862ed51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea72228-664e-401b-9341-78f47930c0c9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d66bf76-1ac8-4948-a973-4845868c7a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:00 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Volume volume-0ea72228-664e-401b-9341-78f47930c0c9 (0ea72228-664e-401b-9341-78f47930c0c9): created successfully Nov 06 19:54:00 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD Nov 06 19:54:00 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d66bf76-1ac8-4948-a973-4845868c7a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Flow 'volume_create_manager' (7dd61015-9a75-4085-9d7c-1e6daa3f3a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4bbd60a4-cb8d-4c4a-9db4-d78744c8eaa6 tempest-VolumeDependencyTests-1078824222 None] Created volume successfully. Nov 06 19:54:00 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Deleted volume successfully. Nov 06 19:54:00 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Temporary image e5ecfed6-93f7-46ff-b00b-abb684ede4e1 is fetched for user c87a674b4d294ef9a2e2f9c09f8a5d1e. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-17cf5a28-5924-44af-9998-d7f69f551e47 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-1e446efe-d2c0-424c-b09f-2e030cb6ec78-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[637f9c6f-53be-49d9-ba09-ee7042bde074]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:01 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD Nov 06 19:54:01 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:01 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:01 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD Nov 06 19:54:01 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-997183e9-7a7b-4019-83b3-b857dec6df1e-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:01 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a007a09-399c-48fa-9e76-35ebd98a331b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83682e05210f4c93a857567e63755058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:53:59Z,use_quota=True,user_id='c87a674b4d294ef9a2e2f9c09f8a5d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Creating volume 1a007a09-399c-48fa-9e76-35ebd98a331b {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:01 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-997183e9-7a7b-4019-83b3-b857dec6df1e-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:01 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b 1073741824 Nov 06 19:54:01 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-997183e9-7a7b-4019-83b3-b857dec6df1e" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-997183e9-7a7b-4019-83b3-b857dec6df1e" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[417bc719-1034-49a5-832e-327019c2026d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:01 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e Nov 06 19:54:01 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:02 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b 1073741824" returned: 0 in 0.504s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:02 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:02 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b Nov 06 19:54:02 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:02 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e Nov 06 19:54:02 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:02 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b" returned: 0 in 0.280s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.585s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:02 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-997183e9-7a7b-4019-83b3-b857dec6df1e" returned: 0 in 0.282s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Creating offline snapshot 50299b7a-99b3-41d4-abb0-8264ffd5fbee of volume 0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-997183e9-7a7b-4019-83b3-b857dec6df1e" released by "delete_volume" :: held 0.782s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4a646-b966-433e-b98b-11d2b2349251]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Attempting download of e5ecfed6-93f7-46ff-b00b-abb684ede4e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'metadata': {}}])) to volume 1a007a09-399c-48fa-9e76-35ebd98a331b. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created reservations ['b640af55-d3be-47bc-8e4f-1c528d4854dc', '047dafd9-a841-4587-baf3-5485789abf2d', 'df788c5d-b28c-45c2-90a5-fa9267455f17', 'b4fd9fed-24ad-4c42-9b98-4c27c5a4df04'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5319af1b-aeac-417f-b000-50d725ce505a]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_rluuxban {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:02 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 Nov 06 19:54:02 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:02 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:02 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-c53624e0-0d36-485b-8ab1-5aca3618b3f4-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-c53624e0-0d36-485b-8ab1-5aca3618b3f4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:02 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_rluuxban Nov 06 19:54:02 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-c53624e0-0d36-485b-8ab1-5aca3618b3f4" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-c53624e0-0d36-485b-8ab1-5aca3618b3f4" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc39b3-d1c0-4ab1-8a84-ce9503b277c8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_rluuxban" returned: 0 in 0.475s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_rluuxban {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.370s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9" returned: 0 in 0.572s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 Nov 06 19:54:03 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Deleted volume successfully. Nov 06 19:54:03 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee 1G Nov 06 19:54:03 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2a7a07e9-31df-4901-8b1d-55d9ffb40c74 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-997183e9-7a7b-4019-83b3-b857dec6df1e-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:03 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_rluuxban Nov 06 19:54:03 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:03 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4" returned: 0 in 0.457s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_rluuxban" returned: 1 in 0.377s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_rluuxban' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[90df92d9-5708-4550-b6c4-b96db806452c]: (4, 'raw') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4 Nov 06 19:54:03 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:03 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD Nov 06 19:54:03 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:03 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee 1G" returned: 0 in 0.537s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea72228-664e-401b-9341-78f47930c0c9 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea72228-664e-401b-9341-78f47930c0c9 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee Nov 06 19:54:03 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:03 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c53624e0-0d36-485b-8ab1-5aca3618b3f4" returned: 0 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-c53624e0-0d36-485b-8ab1-5aca3618b3f4" released by "delete_volume" :: held 0.846s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created reservations ['d72a447c-0076-485e-84b7-e3c7c3ef6398', 'd88bb815-9d24-4b52-8283-26a19a071ab6', '5d9859ca-5913-48bf-8aa2-fdb238c727e6', 'ef6a0d12-d289-4cba-85eb-9d0499c71e9e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:03 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:03 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:03 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-d1daa7fe-9dff-4caf-a865-0058598611a1-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:04 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea72228-664e-401b-9341-78f47930c0c9 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee" returned: 0 in 0.420s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee is being set with open permissions: ugo+rw Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:04 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD Nov 06 19:54:04 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-d1daa7fe-9dff-4caf-a865-0058598611a1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:04 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee Nov 06 19:54:04 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-d1daa7fe-9dff-4caf-a865-0058598611a1" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-d1daa7fe-9dff-4caf-a865-0058598611a1" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e99cf-e287-47df-ba49-2497642bbdf1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:04 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.322s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Deleted volume successfully. Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b31f0d14-5732-43fe-a954-be5b4bea3ab4 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-c53624e0-0d36-485b-8ab1-5aca3618b3f4-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:04 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 Nov 06 19:54:04 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] e5ecfed6-93f7-46ff-b00b-abb684ede4e1 was raw, converting to qcow2 {{(pid=86928) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 19:54:04 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee" returned: 0 in 0.290s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b Nov 06 19:54:04 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:04 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.info Nov 06 19:54:04 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1" returned: 0 in 0.426s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:04 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1 Nov 06 19:54:04 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.info" returned: 0 in 0.308s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.info is being set with open permissions: ugo+rw Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:04 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.info Nov 06 19:54:04 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-d1daa7fe-9dff-4caf-a865-0058598611a1" returned: 0 in 0.276s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b" returned: 0 in 0.570s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e5ecfed6-93f7-46ff-b00b-abb684ede4e1_tym_f18rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:54:04 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-d1daa7fe-9dff-4caf-a865-0058598611a1" released by "delete_volume" :: held 0.778s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:04 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b 1G Nov 06 19:54:04 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:04 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.info" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created reservations ['b202aff2-7cef-48c1-8680-83b53a85f3d9', 'bf6d7ced-5220-47d2-b907-dc3f92cc0966', '160069a9-7687-49e1-bcd8-ef89fa8e2dfe', 'c3a44d89-86ce-4a56-a863-2afef6e85962'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-337f170f-d897-4704-8a9f-fcc146a427b2 tempest-VolumeDependencyTests-1078824222 None] Create snapshot completed successfully Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:05 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:05 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-7fd82ceb-f69b-47b6-a7b7-c31d165e9953-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-7fd82ceb-f69b-47b6-a7b7-c31d165e9953-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-7fd82ceb-f69b-47b6-a7b7-c31d165e9953" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:05 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b 1G" returned: 0 in 0.442s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Downloaded image e5ecfed6-93f7-46ff-b00b-abb684ede4e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'metadata': {}}])) to volume 1a007a09-399c-48fa-9e76-35ebd98a331b successfully. {{(pid=86928) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Temporary image e5ecfed6-93f7-46ff-b00b-abb684ede4e1 for user c87a674b4d294ef9a2e2f9c09f8a5d1e is deleted. {{(pid=86928) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.volume_utils [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Marking volume 1a007a09-399c-48fa-9e76-35ebd98a331b as bootable. {{(pid=86928) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-7fd82ceb-f69b-47b6-a7b7-c31d165e9953" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Copying metadata from image e5ecfed6-93f7-46ff-b00b-abb684ede4e1 to 1a007a09-399c-48fa-9e76-35ebd98a331b. {{(pid=86928) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Creating volume glance metadata for volume 1a007a09-399c-48fa-9e76-35ebd98a331b backed by image e5ecfed6-93f7-46ff-b00b-abb684ede4e1 with: {'image_id': 'e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '44d80a1d1d98eef5e99ba9a7f8b961a9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86928) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a02167-5af3-4aa6-9aef-1c45cd23ea0d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:05 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1d15d8-30bd-4b29-b55f-befeac44d813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a007a09-399c-48fa-9e76-35ebd98a331b', 'volume_size': 1, 'image_id': 'e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44d80a1d1d98eef5e99ba9a7f8b961a9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '83682e05210f4c93a857567e63755058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6d247e6e87e834c6ca75b855856c3ceeb5f13adcc6a61920849f26298a37474c3a880cd41668ec5d293400c0aa3c471289b59de193d2d48c03aedc0119aa2b5', 'id': 'e5ecfed6-93f7-46ff-b00b-abb684ede4e1', 'created_at': datetime.datetime(2026, 11, 6, 18, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 18, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e5ecfed6-93f7-46ff-b00b-abb684ede4e1/file', 'properties': {}}, 'image_service': }' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2026d02-a1bb-408c-9f1f-6a2721a64923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Deleted volume successfully. Nov 06 19:54:05 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 Nov 06 19:54:05 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Volume volume-1a007a09-399c-48fa-9e76-35ebd98a331b (1a007a09-399c-48fa-9e76-35ebd98a331b): created successfully Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2026d02-a1bb-408c-9f1f-6a2721a64923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Flow 'volume_create_manager' (d4584450-3eae-4f75-9545-d09dcd56a38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b1c95dd5-4616-4404-9ad9-9b9a6ed2663e tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-d1daa7fe-9dff-4caf-a865-0058598611a1-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e671ca80-3076-4706-a92e-915fb616641e tempest-VolumeImageDependencyTests-1600049975 None] Created volume successfully. Nov 06 19:54:05 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953" returned: 0 in 0.413s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:05 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953 Nov 06 19:54:05 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:06 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7fd82ceb-f69b-47b6-a7b7-c31d165e9953" returned: 0 in 0.252s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-7fd82ceb-f69b-47b6-a7b7-c31d165e9953" released by "delete_volume" :: held 0.726s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created reservations ['86ade45a-a405-41e2-8823-69d899f9befe', 'c19869ca-15c9-46e5-94bf-3cb632c6b8f1', '21f833ee-a71b-40c2-8931-098d58e5dc07', '1ca5275c-fe33-4349-8646-b3662ad26b1b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:06 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:06 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-55579912-6dd4-474e-ad8e-49fee65d3d92-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-55579912-6dd4-474e-ad8e-49fee65d3d92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-55579912-6dd4-474e-ad8e-49fee65d3d92" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:06 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.299s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-55579912-6dd4-474e-ad8e-49fee65d3d92" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Deleting offline snapshot 55579912-6dd4-474e-ad8e-49fee65d3d92 of volume b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] snapshot_file for this snap is: volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:54:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Deleted volume successfully. Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[76710471-2259-40f8-b840-3badbab8332d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-12b18f62-e7b0-4f74-9041-5c6c16e5f4f5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-7fd82ceb-f69b-47b6-a7b7-c31d165e9953-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:06 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 Nov 06 19:54:06 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Flow 'volume_create_manager' (a440a8ce-f13e-4e7e-9bc4-eb0fa5a9eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76fb55e-9b8d-4604-8055-a04debc577a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76fb55e-9b8d-4604-8055-a04debc577a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-718319161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729e7e18-a51c-4ddf-b517-5e9d54973b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8485a55b7abb47d8a02ff3603a596c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50299b7a-99b3-41d4-abb0-8264ffd5fbee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:07Z,use_quota=True,user_id='b9c9a86962364f90af06273e2ddf3a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff5c715-40c0-429d-884f-5b9f01bf7f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff5c715-40c0-429d-884f-5b9f01bf7f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbfe3d5-5939-470f-aa8a-c7456a13b038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbfe3d5-5939-470f-aa8a-c7456a13b038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '729e7e18-a51c-4ddf-b517-5e9d54973b6e', 'volume_name': 'volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e', 'volume_size': 1, 'snapshot_id': '50299b7a-99b3-41d4-abb0-8264ffd5fbee'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78a495d-7d7a-450e-b88e-d06b1807d1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78a495d-7d7a-450e-b88e-d06b1807d1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5457134b-1b1a-4a81-8ed2-dcba7670593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:06 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Volume 729e7e18-a51c-4ddf-b517-5e9d54973b6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e', 'volume_size': 1, 'snapshot_id': '50299b7a-99b3-41d4-abb0-8264ffd5fbee'} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Acquiring lock "cinder-1a007a09-399c-48fa-9e76-35ebd98a331b-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-quobyte-50299b7a-99b3-41d4-abb0-8264ffd5fbee-729e7e18-a51c-4ddf-b517-5e9d54973b6e" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Lock "cinder-1a007a09-399c-48fa-9e76-35ebd98a331b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-50299b7a-99b3-41d4-abb0-8264ffd5fbee-729e7e18-a51c-4ddf-b517-5e9d54973b6e" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Creating volume 729e7e18-a51c-4ddf-b517-5e9d54973b6e from snapshot 50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-quobyte-729e7e18-a51c-4ddf-b517-5e9d54973b6e" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-729e7e18-a51c-4ddf-b517-5e9d54973b6e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] snapshot: 50299b7a-99b3-41d4-abb0-8264ffd5fbee, volume: 729e7e18-a51c-4ddf-b517-5e9d54973b6e, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Acquiring lock "cinder-quobyte-1a007a09-399c-48fa-9e76-35ebd98a331b" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Lock "cinder-quobyte-1a007a09-399c-48fa-9e76-35ebd98a331b" acquired by "delete_volume" :: waited 0.058s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff920d6-820e-44d4-a767-1db9cdfb1c5d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5cb8b0-149a-4396-98ec-40bb5a57c628]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:06 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92" returned: 0 in 0.441s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9656b19a-cfee-40b4-a448-c058086708a0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:07 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee Nov 06 19:54:07 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:07 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b Nov 06 19:54:07 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:07 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 Nov 06 19:54:07 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:07 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee" returned: 0 in 0.486s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea72228-664e-401b-9341-78f47930c0c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:54:07 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[87375ac5-e526-488b-b426-7ccba45e69df]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b" returned: 0 in 0.500s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:07 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" returned: 0 in 0.453s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:07 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b Nov 06 19:54:07 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:07 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 Nov 06 19:54:07 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:07 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 Nov 06 19:54:07 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:07 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-1a007a09-399c-48fa-9e76-35ebd98a331b" returned: 0 in 0.346s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Lock "cinder-quobyte-1a007a09-399c-48fa-9e76-35ebd98a331b" released by "delete_volume" :: held 0.906s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Created reservations ['7db85232-163e-45a9-b094-9dd6d9b564aa', '41cee8fd-2c0a-479f-91e2-f0afdfd8bac7', '8dd97154-9ee0-46e5-a37c-8f4ca09dbfe0', 'e6a70838-9f2d-4a24-bcdf-4736c7f661f2'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:07 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9" returned: 0 in 0.515s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:07 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:07 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e Nov 06 19:54:07 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92" returned: 0 in 0.519s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:08 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92 Nov 06 19:54:08 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:08 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:08 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:08 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94.55579912-6dd4-474e-ad8e-49fee65d3d92" returned: 0 in 0.272s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-55579912-6dd4-474e-ad8e-49fee65d3d92" released by "_delete_snapshot" :: held 1.819s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:08 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" released by "delete_snapshot" :: held 1.856s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Deleted volume successfully. Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6ad0934e-1883-424b-b679-03d7ff6d3f0a tempest-VolumeImageDependencyTests-1600049975 None] Lock "cinder-1a007a09-399c-48fa-9e76-35ebd98a331b-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created reservations ['f4ed2651-8b6f-45a8-95f1-b5bb972e2958', '7e1e2a09-a883-47a2-96ec-cf276c8c7efc', '0f6d1b6b-76b4-45ee-b90c-b93091916471', '040c80f0-951d-44f2-b379-a30a2319e694'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Delete snapshot completed successfully. Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a0259224-4ba8-46d9-be27-8512ce8c25a5 tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-55579912-6dd4-474e-ad8e-49fee65d3d92-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "cinder-quobyte-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d206ab2-b826-4849-a8a2-07b9187ed8a1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:09 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 Nov 06 19:54:09 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:09 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" returned: 0 in 1.043s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:10 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94 Nov 06 19:54:10 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:10 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" returned: 0 in 0.677s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-quobyte-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94" released by "delete_volume" :: held 1.877s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:10 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Created reservations ['57e2e0d3-5924-4347-a987-1723c84c1634', '369d47a9-5ea2-4df9-9acb-ef3c397c724a', '98ba5345-b024-4cd2-a381-b99ec31056d5', '6f3c9463-a788-4182-8f88-89d836ed5ae5'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:11 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:11 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:11 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.712s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Deleted volume successfully. Nov 06 19:54:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a7c975d4-6f48-449b-9e22-6257308fbcfa tempest-CreateVolumesFromSnapshotTest-1883790009 None] Lock "cinder-b4f8a6e0-c0a5-4215-b8b7-af6df6c8ba94-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:16 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e" returned: 0 in 8.990s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:16 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9, size 1024.00 MB, duration 8.99 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:54:16 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Converted 1024.00 MB image at 113.88 MB/s Nov 06 19:54:16 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e is being set with open permissions: ugo+rw Nov 06 19:54:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:16 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e Nov 06 19:54:16 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:17 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e" returned: 0 in 0.309s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-729e7e18-a51c-4ddf-b517-5e9d54973b6e" released by "_copy_volume_from_snapshot" :: held 10.437s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-50299b7a-99b3-41d4-abb0-8264ffd5fbee-729e7e18-a51c-4ddf-b517-5e9d54973b6e" released by "_create_volume_from_snapshot" :: held 10.521s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.550s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5457134b-1b1a-4a81-8ed2-dcba7670593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e', 'volume_size': 1, 'snapshot_id': '50299b7a-99b3-41d4-abb0-8264ffd5fbee'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cad68c-cd0a-4ce8-8f94-dca3c9fba4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:17 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Volume volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e (729e7e18-a51c-4ddf-b517-5e9d54973b6e): created successfully Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cad68c-cd0a-4ce8-8f94-dca3c9fba4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Flow 'volume_create_manager' (a440a8ce-f13e-4e7e-9bc4-eb0fa5a9eef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0f527338-ab53-4f34-b64e-c5c9637f1fe3 tempest-VolumeDependencyTests-1078824222 None] Created volume successfully. Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-50299b7a-99b3-41d4-abb0-8264ffd5fbee-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-50299b7a-99b3-41d4-abb0-8264ffd5fbee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-quobyte-0ea72228-664e-401b-9341-78f47930c0c9" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-0ea72228-664e-401b-9341-78f47930c0c9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-quobyte-50299b7a-99b3-41d4-abb0-8264ffd5fbee" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-50299b7a-99b3-41d4-abb0-8264ffd5fbee" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Deleting offline snapshot 50299b7a-99b3-41d4-abb0-8264ffd5fbee of volume 0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] snapshot_file for this snap is: volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc8220d-3882-4628-984b-dac7fdf561da]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:18 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee Nov 06 19:54:18 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:18 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee" returned: 0 in 0.445s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea72228-664e-401b-9341-78f47930c0c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:54:18 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[901a03a0-34ed-456e-b78d-de3d4eaf3377]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:18 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 Nov 06 19:54:18 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:19 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9" returned: 0 in 0.568s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:19 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee Nov 06 19:54:19 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:19 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee" returned: 0 in 0.427s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:19 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee Nov 06 19:54:19 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:19 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9.50299b7a-99b3-41d4-abb0-8264ffd5fbee" returned: 0 in 0.271s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-50299b7a-99b3-41d4-abb0-8264ffd5fbee" released by "_delete_snapshot" :: held 1.866s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-0ea72228-664e-401b-9341-78f47930c0c9" released by "delete_snapshot" :: held 1.897s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Created reservations ['eb06b426-e77a-4407-8be2-a4b117809d3e', '765eb10d-cdbc-4f54-b0e5-51372438609a', '2a67bc0b-e692-4f8e-a337-1a311807be70', '89ed888d-3743-4013-bd36-e9c15461a94c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:19 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Delete snapshot completed successfully. Nov 06 19:54:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-eedeed5b-2518-4b88-8d5f-e039a8c32e96 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-50299b7a-99b3-41d4-abb0-8264ffd5fbee-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-0ea72228-664e-401b-9341-78f47930c0c9-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-0ea72228-664e-401b-9341-78f47930c0c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-quobyte-0ea72228-664e-401b-9341-78f47930c0c9" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-0ea72228-664e-401b-9341-78f47930c0c9" acquired by "delete_volume" :: waited 0.036s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3217e620-f319-42b4-a5cc-9f8b8f372280]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:20 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 Nov 06 19:54:20 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:20 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9" returned: 0 in 0.604s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:20 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9 Nov 06 19:54:20 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:21 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-0ea72228-664e-401b-9341-78f47930c0c9" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-0ea72228-664e-401b-9341-78f47930c0c9" released by "delete_volume" :: held 0.956s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Created reservations ['1558d4e3-ba3b-4c0d-b4ca-575a9b148886', '145f741e-00ae-466b-8e4f-330005d19b65', 'd3f77374-597a-4395-ace6-ebc0ee869662', 'f8fc9f67-a286-4e89-a474-14f95af2f832'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:21 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:21 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:21 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.263s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Deleted volume successfully. Nov 06 19:54:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-db41d5b7-1122-46d3-938e-d72e4fbc9ac0 tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-0ea72228-664e-401b-9341-78f47930c0c9-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-729e7e18-a51c-4ddf-b517-5e9d54973b6e-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-729e7e18-a51c-4ddf-b517-5e9d54973b6e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "cinder-quobyte-729e7e18-a51c-4ddf-b517-5e9d54973b6e" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-729e7e18-a51c-4ddf-b517-5e9d54973b6e" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba71f6-e0b0-45ec-afc0-633be1c888d6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:22 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e Nov 06 19:54:22 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:23 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e" returned: 0 in 0.542s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:23 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e Nov 06 19:54:23 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:23 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-729e7e18-a51c-4ddf-b517-5e9d54973b6e" returned: 0 in 0.344s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-quobyte-729e7e18-a51c-4ddf-b517-5e9d54973b6e" released by "delete_volume" :: held 0.977s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Created reservations ['1c0a263f-ea6f-4066-87a8-13d06b845e13', 'e98d3ce7-35e3-4d99-b87d-749597a71cd5', '308d9b2c-1c14-47c3-80ec-73849a88c845', '9489a5cb-3702-46d6-b77a-53fb88ab6a37'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:23 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:23 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:24 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.370s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:24 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:24 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Deleted volume successfully. Nov 06 19:54:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4ec3efa5-c8e2-467d-b683-3d8e95bde39b tempest-VolumeDependencyTests-1078824222 None] Lock "cinder-729e7e18-a51c-4ddf-b517-5e9d54973b6e-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (a1628e1a-a278-48c1-8fa2-a161b50af62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43089e08-8c12-48d1-852a-1ba7114929bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43089e08-8c12-48d1-852a-1ba7114929bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052480418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dc6088-706c-4410-bc46-26756c5198a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:25Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec2a71c-0984-4325-995e-d079e142949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec2a71c-0984-4325-995e-d079e142949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f524c4-486a-4a28-ae19-ef243ed24d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f524c4-486a-4a28-ae19-ef243ed24d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55dc6088-706c-4410-bc46-26756c5198a9', 'volume_name': 'volume-55dc6088-706c-4410-bc46-26756c5198a9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae63aed-812d-4679-8cb2-829c7005c8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae63aed-812d-4679-8cb2-829c7005c8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cfd69e-8980-497d-ad93-d012a25c4182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Volume 55dc6088-706c-4410-bc46-26756c5198a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55dc6088-706c-4410-bc46-26756c5198a9', 'volume_size': 1} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052480418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dc6088-706c-4410-bc46-26756c5198a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:25Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Creating volume 55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:25 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:25 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 1073741824 Nov 06 19:54:25 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:25 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 1073741824" returned: 0 in 0.576s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:25 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 Nov 06 19:54:25 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:26 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9" returned: 0 in 0.418s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cfd69e-8980-497d-ad93-d012a25c4182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55dc6088-706c-4410-bc46-26756c5198a9', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a8d938-aade-47af-8b45-88d2db72721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:26 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Volume volume-55dc6088-706c-4410-bc46-26756c5198a9 (55dc6088-706c-4410-bc46-26756c5198a9): created successfully Nov 06 19:54:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a8d938-aade-47af-8b45-88d2db72721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:26 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (a1628e1a-a278-48c1-8fa2-a161b50af62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:26 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cf10619b-5c11-4622-bb6e-2d34c37fd667 tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:54:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:27 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot 4562e1ba-42a7-4779-82ed-34b492093575 of volume 55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:54:27 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80fd92-23e1-4cfe-912a-f2b8f9fb96a1]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:28 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 Nov 06 19:54:28 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:28 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9" returned: 0 in 0.514s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:28 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 1G Nov 06 19:54:28 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:28 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=205,cinder:UPDATE=275,cinder:INSERT=77,cinder:DELETE=32 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:54:28 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=204,cinder:UPDATE=287,cinder:DELETE=18,cinder:INSERT=73 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:54:28 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Flow 'volume_create_manager' (3598d619-7949-40ac-94c3-b7233f5c33d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:28 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f844f6-19d0-4259-a9fd-2d6474ce3a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f844f6-19d0-4259-a9fd-2d6474ce3a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424915960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f80d08577c14fe4983987c8f38dd3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:29Z,use_quota=True,user_id='7f09bdfe204f4ce1837c0cc934424043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:29 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361dc709-4284-463d-9ad2-004a7f91d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361dc709-4284-463d-9ad2-004a7f91d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7661806-1ce8-46a4-94f3-434708e5c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7661806-1ce8-46a4-94f3-434708e5c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55', 'volume_name': 'volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeaa6211-a28e-4b58-9215-1d51f2f3394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeaa6211-a28e-4b58-9215-1d51f2f3394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0603d7-1d24-4691-b60d-107f5d2ca3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:29 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Volume 5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55', 'volume_size': 1} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 1G" returned: 0 in 0.584s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55dc6088-706c-4410-bc46-26756c5198a9 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:29 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55dc6088-706c-4410-bc46-26756c5198a9 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 Nov 06 19:54:29 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:29 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55dc6088-706c-4410-bc46-26756c5198a9 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575" returned: 0 in 0.296s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:29 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 is being set with open permissions: ugo+rw Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:29 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 Nov 06 19:54:29 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:29 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:29 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.info Nov 06 19:54:29 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:29 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.info" returned: 0 in 0.309s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:29 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.info is being set with open permissions: ugo+rw Nov 06 19:54:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:29 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.info Nov 06 19:54:29 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:30 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.info" returned: 0 in 0.277s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.210s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424915960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f80d08577c14fe4983987c8f38dd3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:29Z,use_quota=True,user_id='7f09bdfe204f4ce1837c0cc934424043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Creating volume 5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:30 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:30 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 1073741824 Nov 06 19:54:30 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-14b63c46-7ef0-4f51-9a13-44c09ea5579c tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:54:30 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 1073741824" returned: 0 in 0.501s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:30 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 Nov 06 19:54:30 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-4562e1ba-42a7-4779-82ed-34b492093575-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-4562e1ba-42a7-4779-82ed-34b492093575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-55dc6088-706c-4410-bc46-26756c5198a9" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-55dc6088-706c-4410-bc46-26756c5198a9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-4562e1ba-42a7-4779-82ed-34b492093575" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:31 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55" returned: 0 in 0.338s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0603d7-1d24-4691-b60d-107f5d2ca3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c074d0-9f3c-4372-aa3d-c861c7facd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-4562e1ba-42a7-4779-82ed-34b492093575" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot 4562e1ba-42a7-4779-82ed-34b492093575 of volume 55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ac1dc-f3cb-49f2-b664-8700206de9f8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:31 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Volume volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 (5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55): created successfully Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c074d0-9f3c-4372-aa3d-c861c7facd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Flow 'volume_create_manager' (3598d619-7949-40ac-94c3-b7233f5c33d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b884315d-1fb6-4d9e-86b9-cfd394b4d86e tempest-ProjectReaderTests-1788731969 None] Created volume successfully. Nov 06 19:54:31 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 Nov 06 19:54:31 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:31 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575" returned: 0 in 0.396s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55dc6088-706c-4410-bc46-26756c5198a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da3d96f-45e6-466e-a903-b96340f29d44]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:31 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 Nov 06 19:54:31 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:32 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9" returned: 0 in 0.418s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:32 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 Nov 06 19:54:32 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Acquiring lock "cinder-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:32 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575" returned: 0 in 0.506s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Acquiring lock "cinder-quobyte-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:32 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575 Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-quobyte-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:32 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c942cfaa-82f7-4ef7-b7b2-ae69f6453b69]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:32 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 Nov 06 19:54:32 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:32 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9.4562e1ba-42a7-4779-82ed-34b492093575" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-4562e1ba-42a7-4779-82ed-34b492093575" released by "_delete_snapshot" :: held 1.762s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:32 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-55dc6088-706c-4410-bc46-26756c5198a9" released by "delete_snapshot" :: held 1.808s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Created reservations ['15a86a2a-ce2e-48ae-a6d2-abd4197cea39', '4a27c44a-4071-436c-b05a-432bd56f0288', 'eb238b40-15e0-4b97-8c6e-5ebe3e5435e7', 'b5b7a950-bd3a-424a-868f-0c20fcd4be27'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:33 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2c744ab4-e79d-47bb-9f71-7dbb9a574078 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-4562e1ba-42a7-4779-82ed-34b492093575-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:33 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55" returned: 0 in 0.467s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:33 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55 Nov 06 19:54:33 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-55dc6088-706c-4410-bc46-26756c5198a9-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-55dc6088-706c-4410-bc46-26756c5198a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-55dc6088-706c-4410-bc46-26756c5198a9" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-55dc6088-706c-4410-bc46-26756c5198a9" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:33 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55" returned: 0 in 0.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[e959c06d-821e-48a9-b5ee-d12eb8002402]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-quobyte-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55" released by "delete_volume" :: held 0.890s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Created reservations ['c71656cb-92de-4814-b78c-274305fdacca', '60c50870-a3d5-42e5-b9f1-61e9b99477e7', 'fd45f515-70db-44b0-abc7-de01cd927298', '6d8b321e-c71b-4c2a-a3b9-de26afa1b638'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:33 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 Nov 06 19:54:33 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:33 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:33 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:34 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.454s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:34 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Deleted volume successfully. Nov 06 19:54:34 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9" returned: 0 in 0.734s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a5e85dee-0359-4efd-8f54-5d6d97491fd0 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-5f6ab613-dc1b-4036-bb31-cb4c2c0c7f55-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:34 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9 Nov 06 19:54:34 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Flow 'volume_create_manager' (3c4c0e86-a0d2-4e00-a021-ee5dde99cac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85be01c-dfda-4974-9602-b8d1e8d33f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85be01c-dfda-4974-9602-b8d1e8d33f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559356377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fc08d4-6f6e-4bc2-af73-932016cb6323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f80d08577c14fe4983987c8f38dd3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:34Z,use_quota=True,user_id='7f09bdfe204f4ce1837c0cc934424043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaadb582-286b-4f53-afdf-9d8d8209dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaadb582-286b-4f53-afdf-9d8d8209dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3e3cb0-128b-475e-adb4-879de480906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3e3cb0-128b-475e-adb4-879de480906a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fc08d4-6f6e-4bc2-af73-932016cb6323', 'volume_name': 'volume-38fc08d4-6f6e-4bc2-af73-932016cb6323', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea92307-482a-4449-bdf9-0735b4721fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea92307-482a-4449-bdf9-0735b4721fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c1bc66-0f51-404e-a5ce-db7f70a5f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:34 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Volume 38fc08d4-6f6e-4bc2-af73-932016cb6323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fc08d4-6f6e-4bc2-af73-932016cb6323', 'volume_size': 1} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559356377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fc08d4-6f6e-4bc2-af73-932016cb6323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f80d08577c14fe4983987c8f38dd3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:34Z,use_quota=True,user_id='7f09bdfe204f4ce1837c0cc934424043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Creating volume 38fc08d4-6f6e-4bc2-af73-932016cb6323 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:34 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:34 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-55dc6088-706c-4410-bc46-26756c5198a9" returned: 0 in 0.306s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:34 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 1073741824 Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-55dc6088-706c-4410-bc46-26756c5198a9" released by "delete_volume" :: held 1.130s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:34 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Created reservations ['018dfa50-383b-42f6-b02a-1c5e04c33760', '14672a46-39c6-4dee-9d83-bf06c0e59e39', '89c2d07a-1930-4090-a254-6a33e9b41853', '058c7381-bf25-45df-90d5-fd2e12ad5aea'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:34 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:34 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:35 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.283s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d431b15b-6478-4d97-b682-8339bf6bb09d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-55dc6088-706c-4410-bc46-26756c5198a9-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:35 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 1073741824" returned: 0 in 0.553s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:35 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 Nov 06 19:54:35 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:35 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323" returned: 0 in 0.538s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c1bc66-0f51-404e-a5ce-db7f70a5f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fc08d4-6f6e-4bc2-af73-932016cb6323', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b082eb-c6ee-4874-8960-9d16e29714b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Volume volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 (38fc08d4-6f6e-4bc2-af73-932016cb6323): created successfully Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b082eb-c6ee-4874-8960-9d16e29714b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Flow 'volume_create_manager' (3c4c0e86-a0d2-4e00-a021-ee5dde99cac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:35 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f03573f7-2a78-40e3-a7e5-9b25be9b793b tempest-ProjectReaderTests-1788731969 None] Created volume successfully. Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (904afd74-acf3-494a-8ebc-26e0e0962f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b89bb4-cb16-4ac6-bf58-394a06cf9a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b89bb4-cb16-4ac6-bf58-394a06cf9a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787288938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1d599c-a475-48c8-a327-f4ad187c2731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:36Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37456f01-4175-422d-a166-aa073899c140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37456f01-4175-422d-a166-aa073899c140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12edccf1-aefe-4c2c-9700-11e1e893693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12edccf1-aefe-4c2c-9700-11e1e893693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1d599c-a475-48c8-a327-f4ad187c2731', 'volume_name': 'volume-2a1d599c-a475-48c8-a327-f4ad187c2731', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c36a423-df12-4733-b2cf-e29e7db0b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c36a423-df12-4733-b2cf-e29e7db0b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235cf1b8-7bac-4c5e-8cfb-160b446d15c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:35 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Volume 2a1d599c-a475-48c8-a327-f4ad187c2731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1d599c-a475-48c8-a327-f4ad187c2731', 'volume_size': 1} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787288938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1d599c-a475-48c8-a327-f4ad187c2731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:36Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Creating volume 2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:35 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:35 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 1073741824 Nov 06 19:54:35 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (f7a62f55-0624-4e1a-be33-dd749f4481b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f7738f-19ef-470f-8945-f69deb0edc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f7738f-19ef-470f-8945-f69deb0edc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1386661499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114e9a65-5e4b-41b3-bf91-33bac92c5f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:36Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c62d68e-2a76-46a7-ac8e-8d86579c74a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c62d68e-2a76-46a7-ac8e-8d86579c74a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d166f69-a57e-4763-9125-1ed08a3791d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d166f69-a57e-4763-9125-1ed08a3791d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114e9a65-5e4b-41b3-bf91-33bac92c5f47', 'volume_name': 'volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c27b5b-d0a1-46d9-8199-f8b842752484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c27b5b-d0a1-46d9-8199-f8b842752484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738cefcf-2b3c-4317-aa2a-158d73e3b61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:36 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Volume 114e9a65-5e4b-41b3-bf91-33bac92c5f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47', 'volume_size': 1} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:36 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 1073741824" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Acquiring lock "cinder-38fc08d4-6f6e-4bc2-af73-932016cb6323-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:36 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 Nov 06 19:54:36 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-38fc08d4-6f6e-4bc2-af73-932016cb6323-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Acquiring lock "cinder-quobyte-38fc08d4-6f6e-4bc2-af73-932016cb6323" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-quobyte-38fc08d4-6f6e-4bc2-af73-932016cb6323" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07f8703-c800-4c11-8d48-d9ec321c5867]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:36 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 Nov 06 19:54:36 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:36 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731" returned: 0 in 0.293s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1386661499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114e9a65-5e4b-41b3-bf91-33bac92c5f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:36Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Creating volume 114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:36 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:36 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 1073741824 Nov 06 19:54:36 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235cf1b8-7bac-4c5e-8cfb-160b446d15c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1d599c-a475-48c8-a327-f4ad187c2731', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455b2bba-831a-46b9-b472-73820308a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:36 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Volume volume-2a1d599c-a475-48c8-a327-f4ad187c2731 (2a1d599c-a475-48c8-a327-f4ad187c2731): created successfully Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455b2bba-831a-46b9-b472-73820308a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (904afd74-acf3-494a-8ebc-26e0e0962f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9be58982-a211-4915-9ea3-e91e0e0569eb tempest-ProjectReaderTests-502416004 None] Created volume successfully. Nov 06 19:54:37 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323" returned: 0 in 0.453s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:37 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323 Nov 06 19:54:37 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:37 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 1073741824" returned: 0 in 0.536s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:37 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-38fc08d4-6f6e-4bc2-af73-932016cb6323" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:37 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 Nov 06 19:54:37 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-quobyte-38fc08d4-6f6e-4bc2-af73-932016cb6323" released by "delete_volume" :: held 0.830s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Created reservations ['8e79ddd5-e604-4ce2-a14c-d62fa0aa648c', '52c9b27f-e3bc-4957-b901-d1356354ac3a', '034170db-3ba7-4c07-ba82-14e10e7ae330', 'bd9c201a-f297-4248-aeee-ac0189f25431'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:37 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:37 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:37 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47" returned: 0 in 0.250s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738cefcf-2b3c-4317-aa2a-158d73e3b61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2adbe5c8-5b49-4fc7-91e9-d250fa6b3ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Volume volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 (114e9a65-5e4b-41b3-bf91-33bac92c5f47): created successfully Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2adbe5c8-5b49-4fc7-91e9-d250fa6b3ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (f7a62f55-0624-4e1a-be33-dd749f4481b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9b987cdb-abff-46c1-a4c2-53d1ff80d8fb tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:54:37 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Deleted volume successfully. Nov 06 19:54:37 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f120988e-7070-4fb3-98cb-36f74c45a453 tempest-ProjectReaderTests-1788731969 None] Lock "cinder-38fc08d4-6f6e-4bc2-af73-932016cb6323-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Creating offline snapshot cecab753-8c65-4ca3-b154-768a05e39f06 of volume 2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a72ce0-2ddb-4ca7-a004-262211418bf3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:38 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 Nov 06 19:54:38 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:38 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731" returned: 0 in 0.496s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:38 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:38 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 1G Nov 06 19:54:38 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:39 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 1G" returned: 0 in 0.490s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d599c-a475-48c8-a327-f4ad187c2731 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:39 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d599c-a475-48c8-a327-f4ad187c2731 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 Nov 06 19:54:39 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:39 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d599c-a475-48c8-a327-f4ad187c2731 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06" returned: 0 in 0.336s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:39 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 is being set with open permissions: ugo+rw Nov 06 19:54:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:39 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 Nov 06 19:54:39 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:39 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06" returned: 0 in 0.288s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:39 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.info Nov 06 19:54:39 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:40 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.info" returned: 0 in 0.275s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:40 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.info is being set with open permissions: ugo+rw Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:40 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.info Nov 06 19:54:40 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:40 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.info" returned: 0 in 0.283s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.938s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot 0d32df1b-ba46-4db6-87e9-cdb69cb52bcf of volume 114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:54:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-26dc2a0a-371b-4a32-840e-cc58b63b95b1 tempest-ProjectReaderTests-502416004 None] Create snapshot completed successfully Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0352351f-0e3d-402c-947d-676f4b2479e0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:40 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 Nov 06 19:54:40 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:40 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47" returned: 0 in 0.414s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:41 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf 1G Nov 06 19:54:41 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:41 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf 1G" returned: 0 in 0.539s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:41 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf Nov 06 19:54:41 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-cecab753-8c65-4ca3-b154-768a05e39f06-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Lock "cinder-cecab753-8c65-4ca3-b154-768a05e39f06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-2a1d599c-a475-48c8-a327-f4ad187c2731" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-2a1d599c-a475-48c8-a327-f4ad187c2731" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-cecab753-8c65-4ca3-b154-768a05e39f06" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-cecab753-8c65-4ca3-b154-768a05e39f06" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Deleting offline snapshot cecab753-8c65-4ca3-b154-768a05e39f06 of volume 2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] snapshot_file for this snap is: volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e039d-1204-4f2c-ad74-d08d01f62125]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:41 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" returned: 0 in 0.443s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:41 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf is being set with open permissions: ugo+rw Nov 06 19:54:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:41 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf Nov 06 19:54:41 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:42 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 Nov 06 19:54:42 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:42 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" returned: 0 in 0.397s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:42 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06" returned: 0 in 0.496s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1d599c-a475-48c8-a327-f4ad187c2731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:54:42 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.info Nov 06 19:54:42 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d54b448-4b9a-4f1a-b5b7-60051ad202dc]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:42 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 Nov 06 19:54:42 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:42 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.info" returned: 0 in 0.316s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:42 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.info is being set with open permissions: ugo+rw Nov 06 19:54:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:42 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.info Nov 06 19:54:42 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:43 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.info" returned: 0 in 0.321s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:43 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ad832d30-2a56-4891-b69e-17bcedf30a53 tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:54:43 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731" returned: 0 in 0.630s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:43 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 Nov 06 19:54:43 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:43 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06" returned: 0 in 0.441s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:43 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06 Nov 06 19:54:43 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Flow 'volume_create_manager' (0adecf0a-e7c0-4ee9-a4ed-7750bddfe6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce33f2d3-09f7-48c6-ab24-df37607db75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-0d32df1b-ba46-4db6-87e9-cdb69cb52bcf-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce33f2d3-09f7-48c6-ab24-df37607db75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1708669286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d1f397-b144-407e-bccc-5ad0545fde6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ce6aeb6840f5b2fa67e93b47048f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:44Z,use_quota=True,user_id='85b166b24c5e4ab5bbb2a8e7636295c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ac4273-14e7-435a-8f1d-2a4c51749494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ac4273-14e7-435a-8f1d-2a4c51749494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496d06dc-5b16-4878-aa6a-33e776b099e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496d06dc-5b16-4878-aa6a-33e776b099e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d1f397-b144-407e-bccc-5ad0545fde6c', 'volume_name': 'volume-42d1f397-b144-407e-bccc-5ad0545fde6c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193e8f6d-e70a-4ba8-8079-bf4b33ef6c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:43 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193e8f6d-e70a-4ba8-8079-bf4b33ef6c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9acf54a-4842-4387-992d-439ac5acee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:43 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Volume 42d1f397-b144-407e-bccc-5ad0545fde6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d1f397-b144-407e-bccc-5ad0545fde6c', 'volume_size': 1} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1708669286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d1f397-b144-407e-bccc-5ad0545fde6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ce6aeb6840f5b2fa67e93b47048f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:44Z,use_quota=True,user_id='85b166b24c5e4ab5bbb2a8e7636295c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Creating volume 42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:43 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731.cecab753-8c65-4ca3-b154-768a05e39f06" returned: 0 in 0.354s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:43 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c 1073741824 Nov 06 19:54:43 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-0d32df1b-ba46-4db6-87e9-cdb69cb52bcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.120s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-114e9a65-5e4b-41b3-bf91-33bac92c5f47" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-cecab753-8c65-4ca3-b154-768a05e39f06" released by "_delete_snapshot" :: held 2.084s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-114e9a65-5e4b-41b3-bf91-33bac92c5f47" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-2a1d599c-a475-48c8-a327-f4ad187c2731" released by "delete_snapshot" :: held 2.118s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot 0d32df1b-ba46-4db6-87e9-cdb69cb52bcf of volume 114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bae9ca-8cf1-4e4a-92da-daf2cac0f010]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Created reservations ['519cbdd6-78b0-4fd8-abe1-41cdf39a266d', '2c75d3a2-a1c9-4d22-afc6-983d277dabde', 'dc9d9094-5528-4ea4-bd74-4d2e14734165', 'c9ce1137-8658-4d6b-b6cf-ba31b3416190'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Delete snapshot completed successfully. Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-b5e042d7-8c73-421b-804f-69d521807bde tempest-ProjectReaderTests-502416004 None] Lock "cinder-cecab753-8c65-4ca3-b154-768a05e39f06-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:44 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf Nov 06 19:54:44 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:44 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c 1073741824" returned: 0 in 0.490s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:44 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c Nov 06 19:54:44 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:44 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" returned: 0 in 0.471s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[619029b3-a0ac-4598-8d36-dbe314ed3c80]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:44 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 Nov 06 19:54:44 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:44 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c" returned: 0 in 0.301s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9acf54a-4842-4387-992d-439ac5acee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d1f397-b144-407e-bccc-5ad0545fde6c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fae144a-a98f-411b-8e80-d84bc6b22e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:44 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Volume volume-42d1f397-b144-407e-bccc-5ad0545fde6c (42d1f397-b144-407e-bccc-5ad0545fde6c): created successfully Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fae144a-a98f-411b-8e80-d84bc6b22e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Flow 'volume_create_manager' (0adecf0a-e7c0-4ee9-a4ed-7750bddfe6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9b0665e4-a960-4241-8dfa-b92c4416fd43 tempest-SnapshotDependencyTests-444248877 None] Created volume successfully. Nov 06 19:54:44 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:45 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf Nov 06 19:54:45 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-2a1d599c-a475-48c8-a327-f4ad187c2731-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Lock "cinder-2a1d599c-a475-48c8-a327-f4ad187c2731-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-2a1d599c-a475-48c8-a327-f4ad187c2731" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-2a1d599c-a475-48c8-a327-f4ad187c2731" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4c132-66c7-4815-bf1b-935c9a375dda]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:45 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 Nov 06 19:54:45 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:45 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" returned: 0 in 0.402s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:45 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf Nov 06 19:54:45 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:45 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731" returned: 0 in 0.403s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:45 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731 Nov 06 19:54:45 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:45 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47.0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" returned: 0 in 0.298s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-0d32df1b-ba46-4db6-87e9-cdb69cb52bcf" released by "_delete_snapshot" :: held 1.714s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-114e9a65-5e4b-41b3-bf91-33bac92c5f47" released by "delete_snapshot" :: held 1.753s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Created reservations ['3035938f-1a27-4e12-bc39-12cfad0fce48', '63d3b2d2-ee99-4d28-9356-1d4a60e7ab00', 'accb0568-d0d8-4dbd-8653-9cff88b87b1e', '1e0e310f-830f-4775-b543-4d32036ec24a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:45 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2a1d599c-a475-48c8-a327-f4ad187c2731" returned: 0 in 0.282s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0e6b1c2c-9d8c-4136-9721-f79e1c314fb4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-0d32df1b-ba46-4db6-87e9-cdb69cb52bcf-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-2a1d599c-a475-48c8-a327-f4ad187c2731" released by "delete_volume" :: held 0.773s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:45 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Created reservations ['8d25a613-3f01-404e-ab73-4a096786d3a1', 'd7993c1a-81c9-4689-9a76-759435fad12e', 'f70987ba-9bbe-492e-bf1b-5271f3cfc58d', '715840b8-6372-4189-82da-7d48179f02bd'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-114e9a65-5e4b-41b3-bf91-33bac92c5f47-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Lock "cinder-114e9a65-5e4b-41b3-bf91-33bac92c5f47-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:46 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:46 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-114e9a65-5e4b-41b3-bf91-33bac92c5f47" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-114e9a65-5e4b-41b3-bf91-33bac92c5f47" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ba24d7-9a1c-4782-a83b-e5be6226cbe8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Creating offline snapshot f864e8bc-d595-43b3-96ed-74d603b723f1 of volume 42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed1c550-08c1-43ad-adc5-aad3aea67616]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:46 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 Nov 06 19:54:46 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:46 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.410s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:46 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Deleted volume successfully. Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f017d2e9-7bee-452b-aba4-482f21a47c18 tempest-ProjectReaderTests-502416004 None] Lock "cinder-2a1d599c-a475-48c8-a327-f4ad187c2731-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:46 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c Nov 06 19:54:46 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:46 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:46 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c" returned: 0 in 0.477s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47" returned: 0 in 0.572s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:46 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 1G Nov 06 19:54:46 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:46 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47 Nov 06 19:54:46 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (dcbd3f37-46a5-412a-9ec4-7f8e50283f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c38e76c-e990-4480-a63f-6486c0463ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:46 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c38e76c-e990-4480-a63f-6486c0463ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414880424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c013f5-5b64-412f-8d08-dc70f1447fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:47Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275be329-6dbd-4697-9c3d-a00f2456f113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275be329-6dbd-4697-9c3d-a00f2456f113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ab7a51-09da-45bc-aa03-0f7fbded4bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ab7a51-09da-45bc-aa03-0f7fbded4bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c013f5-5b64-412f-8d08-dc70f1447fa8', 'volume_name': 'volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e78984-8667-4468-a74d-f9d4421199fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e78984-8667-4468-a74d-f9d4421199fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e135268e-2eba-44d5-93ef-478019b00ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:47 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Volume f7c013f5-5b64-412f-8d08-dc70f1447fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8', 'volume_size': 1} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:47 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-114e9a65-5e4b-41b3-bf91-33bac92c5f47" returned: 0 in 0.308s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:47 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:47 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-114e9a65-5e4b-41b3-bf91-33bac92c5f47" released by "delete_volume" :: held 1.005s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Created reservations ['aafb4bc7-726e-4b6e-859e-1b016f768800', '4b84846c-c427-46a7-b36d-78a81e60f386', 'e1b0b3dd-76fd-495e-92fb-90644c340178', 'fdebbd09-1281-466c-a35b-8240a4dc6714'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:47 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 1G" returned: 0 in 0.558s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:47 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:47 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d1f397-b144-407e-bccc-5ad0545fde6c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:47 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d1f397-b144-407e-bccc-5ad0545fde6c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 Nov 06 19:54:47 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:47 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:54:47 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.296s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-cd625c49-7462-4707-8060-ca37c3fc25ab tempest-ProjectMemberTests-1241856426 None] Lock "cinder-114e9a65-5e4b-41b3-bf91-33bac92c5f47-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:47 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d1f397-b144-407e-bccc-5ad0545fde6c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1" returned: 0 in 0.360s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:47 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 is being set with open permissions: ugo+rw Nov 06 19:54:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:47 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 Nov 06 19:54:47 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:48 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (85adf872-fcdc-4ec8-b681-b12ca2dc98f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545dfed4-f287-4915-9c55-4bd599a669c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1" returned: 0 in 0.292s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545dfed4-f287-4915-9c55-4bd599a669c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222843956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667306e9-6cd3-48bd-bb99-848b4980676d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:48Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193f969-b299-419b-b37d-c29d8261b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3193f969-b299-419b-b37d-c29d8261b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb6a821-91ae-4f67-8347-a91c50158363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb6a821-91ae-4f67-8347-a91c50158363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667306e9-6cd3-48bd-bb99-848b4980676d', 'volume_name': 'volume-667306e9-6cd3-48bd-bb99-848b4980676d', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b9687d-b516-4415-896a-97e66671ff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b9687d-b516-4415-896a-97e66671ff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e0bbda-0f3f-4dbb-b1a2-300dfb9f312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Volume 667306e9-6cd3-48bd-bb99-848b4980676d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667306e9-6cd3-48bd-bb99-848b4980676d', 'volume_size': 1} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:48 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.info Nov 06 19:54:48 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:48 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.info" returned: 0 in 0.255s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:48 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.info is being set with open permissions: ugo+rw Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:48 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.info Nov 06 19:54:48 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:48 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.info" returned: 0 in 0.258s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1414880424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c013f5-5b64-412f-8d08-dc70f1447fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:47Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Creating volume f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:48 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:48 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 1073741824 Nov 06 19:54:48 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:48 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3648fbb4-efa0-48e4-8360-bc0a479ba514 tempest-SnapshotDependencyTests-444248877 None] Create snapshot completed successfully Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (359e6daf-4b2f-41d6-9889-5c0c143701b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba1f82d-5cff-41a9-9f88-153be31aec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba1f82d-5cff-41a9-9f88-153be31aec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665311032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c263779-2a82-4a96-882b-955f75a04c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:49Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9737749f-df6a-4631-98aa-7e2428d2ea7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9737749f-df6a-4631-98aa-7e2428d2ea7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f8f0c5-a898-4db7-9c11-1d2f669b3542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f8f0c5-a898-4db7-9c11-1d2f669b3542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c263779-2a82-4a96-882b-955f75a04c41', 'volume_name': 'volume-7c263779-2a82-4a96-882b-955f75a04c41', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07460e58-e117-42a7-bd04-b6fe7559c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07460e58-e117-42a7-bd04-b6fe7559c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41f80b8-a1a5-4e52-80af-4ee9c8c1b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:48 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Volume 7c263779-2a82-4a96-882b-955f75a04c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c263779-2a82-4a96-882b-955f75a04c41', 'volume_size': 1} Nov 06 19:54:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:49 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 1073741824" returned: 0 in 0.441s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:49 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 Nov 06 19:54:49 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:49 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8" returned: 0 in 0.252s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222843956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667306e9-6cd3-48bd-bb99-848b4980676d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:48Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Creating volume 667306e9-6cd3-48bd-bb99-848b4980676d {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:49 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e135268e-2eba-44d5-93ef-478019b00ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:49 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d 1073741824 Nov 06 19:54:49 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9553c5-a994-4e52-8a9f-140b2b0fa583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:49 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Volume volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 (f7c013f5-5b64-412f-8d08-dc70f1447fa8): created successfully Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9553c5-a994-4e52-8a9f-140b2b0fa583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (dcbd3f37-46a5-412a-9ec4-7f8e50283f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-b4942970-5fc4-4b8b-9a09-7c8f8097df80 tempest-ProjectReaderTests-502416004 None] Created volume successfully. Nov 06 19:54:49 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d 1073741824" returned: 0 in 0.502s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:49 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Flow 'volume_create_manager' (f31c4e47-d3e8-45d8-b385-d86d6bc007a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:50 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d Nov 06 19:54:50 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f9584b-ebe6-4ca4-926a-79aedad3aff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f9584b-ebe6-4ca4-926a-79aedad3aff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d22474-a903-4374-980e-37b1b3cac399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b5ce6aeb6840f5b2fa67e93b47048f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f864e8bc-d595-43b3-96ed-74d603b723f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:50Z,use_quota=True,user_id='85b166b24c5e4ab5bbb2a8e7636295c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea02ac38-fc9b-4785-9e68-e641cd8c350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea02ac38-fc9b-4785-9e68-e641cd8c350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ede4508-7567-433e-82fa-11bb44202118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ede4508-7567-433e-82fa-11bb44202118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63d22474-a903-4374-980e-37b1b3cac399', 'volume_name': 'volume-63d22474-a903-4374-980e-37b1b3cac399', 'volume_size': 1, 'snapshot_id': 'f864e8bc-d595-43b3-96ed-74d603b723f1'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f824fa4e-286c-41df-8ebf-4d250f30d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f824fa4e-286c-41df-8ebf-4d250f30d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0e4313-1418-4c68-a7b2-200cecf12cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Volume 63d22474-a903-4374-980e-37b1b3cac399: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63d22474-a903-4374-980e-37b1b3cac399', 'volume_size': 1, 'snapshot_id': 'f864e8bc-d595-43b3-96ed-74d603b723f1'} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:50 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665311032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c263779-2a82-4a96-882b-955f75a04c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:49Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Creating volume 7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:50 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e0bbda-0f3f-4dbb-b1a2-300dfb9f312e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667306e9-6cd3-48bd-bb99-848b4980676d', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:50 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 1073741824 Nov 06 19:54:50 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b382a7-98cd-4331-83a1-cb1b440bc4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:50 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Volume volume-667306e9-6cd3-48bd-bb99-848b4980676d (667306e9-6cd3-48bd-bb99-848b4980676d): created successfully Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b382a7-98cd-4331-83a1-cb1b440bc4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (85adf872-fcdc-4ec8-b681-b12ca2dc98f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:50 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0bb630a4-6f42-454c-b203-947602360b4b tempest-ProjectReaderTests-525116888 None] Created volume successfully. Nov 06 19:54:50 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 1073741824" returned: 0 in 0.422s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:50 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 Nov 06 19:54:50 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:50 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41" returned: 0 in 0.241s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:50 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.874s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-quobyte-f864e8bc-d595-43b3-96ed-74d603b723f1-63d22474-a903-4374-980e-37b1b3cac399" by "_create_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41f80b8-a1a5-4e52-80af-4ee9c8c1b364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c263779-2a82-4a96-882b-955f75a04c41', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d69712-b65a-42f3-9b04-20212b1371ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-f864e8bc-d595-43b3-96ed-74d603b723f1-63d22474-a903-4374-980e-37b1b3cac399" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Creating volume 63d22474-a903-4374-980e-37b1b3cac399 from snapshot f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-quobyte-63d22474-a903-4374-980e-37b1b3cac399" by "_copy_volume_from_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Volume volume-7c263779-2a82-4a96-882b-955f75a04c41 (7c263779-2a82-4a96-882b-955f75a04c41): created successfully Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d69712-b65a-42f3-9b04-20212b1371ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (359e6daf-4b2f-41d6-9889-5c0c143701b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-63d22474-a903-4374-980e-37b1b3cac399" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] snapshot: f864e8bc-d595-43b3-96ed-74d603b723f1, volume: 63d22474-a903-4374-980e-37b1b3cac399, {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 19:54:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c8a3f450-2fa2-4fbb-b5df-ed5736edf99a tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db7fdbb-755b-447e-afc6-23aa91daa1a7]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:51 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 Nov 06 19:54:51 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-667306e9-6cd3-48bd-bb99-848b4980676d-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Lock "cinder-667306e9-6cd3-48bd-bb99-848b4980676d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-quobyte-667306e9-6cd3-48bd-bb99-848b4980676d" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-667306e9-6cd3-48bd-bb99-848b4980676d" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeccf07-b8f1-45c9-9acd-93597c642937]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:51 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1" returned: 0 in 0.379s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d1f397-b144-407e-bccc-5ad0545fde6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaa8e4d-73f6-4dbf-bce6-b8f65f1a4bce]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:51 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d Nov 06 19:54:51 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:51 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c Nov 06 19:54:51 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:51 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d" returned: 0 in 0.392s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:51 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d Nov 06 19:54:51 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:51 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c" returned: 0 in 0.401s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Creating direct copy from snapshot {{(pid=86928) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG cinder.utils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Path /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 not found in is_blk_device check {{(pid=86928) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 19:54:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:51 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 Nov 06 19:54:51 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:52 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-667306e9-6cd3-48bd-bb99-848b4980676d" returned: 0 in 0.271s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-667306e9-6cd3-48bd-bb99-848b4980676d" released by "delete_volume" :: held 0.704s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Created reservations ['432a707f-dd1f-4c02-9cc1-1855931b0bdd', 'e1d07123-3173-440b-9ed6-846743553fe6', 'd0b3159f-1130-4730-bcfb-c400ff54b64d', '1ff8a845-9b00-4d15-87da-5891cb2bdb25'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:52 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:54:52 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:52 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.330s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:54:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Deleted volume successfully. Nov 06 19:54:52 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10e8db3c-ce93-484c-93c5-6a682ec62634 tempest-ProjectReaderTests-525116888 None] Lock "cinder-667306e9-6cd3-48bd-bb99-848b4980676d-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (e35f9ad1-2ef9-4e2a-98a6-3589e528111c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe446eb-08af-444c-9cce-4d163824ed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe446eb-08af-444c-9cce-4d163824ed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206853913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b972299-8653-4e5f-af50-c291a7eecf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:53Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b88e9c2-51e5-4963-a967-604f1f36babc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b88e9c2-51e5-4963-a967-604f1f36babc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed110386-f14d-4e7e-902b-5ed73520ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed110386-f14d-4e7e-902b-5ed73520ce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b972299-8653-4e5f-af50-c291a7eecf99', 'volume_name': 'volume-6b972299-8653-4e5f-af50-c291a7eecf99', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a5ad7a-f333-421b-a619-5df65d13adc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a5ad7a-f333-421b-a619-5df65d13adc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a133a2-0436-4007-8ceb-b4385cfd5d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:53 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Volume 6b972299-8653-4e5f-af50-c291a7eecf99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b972299-8653-4e5f-af50-c291a7eecf99', 'volume_size': 1} Nov 06 19:54:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:54:58 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399" returned: 0 in 6.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.image.image_utils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Image conversion details: src /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 {{(pid=86928) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 19:54:58 devstack cinder-volume[86928]: INFO cinder.image.image_utils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Converted 1024.00 MB image at 160.03 MB/s Nov 06 19:54:58 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 is being set with open permissions: ugo+rw Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:58 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 Nov 06 19:54:58 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:58 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399" returned: 0 in 0.244s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-63d22474-a903-4374-980e-37b1b3cac399" released by "_copy_volume_from_snapshot" :: held 7.532s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-f864e8bc-d595-43b3-96ed-74d603b723f1-63d22474-a903-4374-980e-37b1b3cac399" released by "_create_volume_from_snapshot" :: held 7.603s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.636s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.447s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Creating offline snapshot b41d82c6-06a4-4770-a22c-2f92eb131f15 of volume f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0e4313-1418-4c68-a7b2-200cecf12cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d22474-a903-4374-980e-37b1b3cac399', 'volume_size': 1, 'snapshot_id': 'f864e8bc-d595-43b3-96ed-74d603b723f1'}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f259ec-1689-4cca-8daf-e40b63bf6cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c747d92-6afb-4843-8d6b-925cabd1a144]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:58 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Volume volume-63d22474-a903-4374-980e-37b1b3cac399 (63d22474-a903-4374-980e-37b1b3cac399): created successfully Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f259ec-1689-4cca-8daf-e40b63bf6cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:54:58 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Flow 'volume_create_manager' (f31c4e47-d3e8-45d8-b385-d86d6bc007a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:54:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4f81c21a-abcf-4cee-b235-b688884588c0 tempest-SnapshotDependencyTests-444248877 None] Created volume successfully. Nov 06 19:54:58 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 Nov 06 19:54:58 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:59 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8" returned: 0 in 0.348s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:59 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 1G Nov 06 19:54:59 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:59 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 1G" returned: 0 in 0.371s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:59 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 Nov 06 19:54:59 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:59 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15" returned: 0 in 0.295s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:59 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 is being set with open permissions: ugo+rw Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:59 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 Nov 06 19:54:59 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-f864e8bc-d595-43b3-96ed-74d603b723f1-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-f864e8bc-d595-43b3-96ed-74d603b723f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-quobyte-42d1f397-b144-407e-bccc-5ad0545fde6c" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-42d1f397-b144-407e-bccc-5ad0545fde6c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-quobyte-f864e8bc-d595-43b3-96ed-74d603b723f1" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-f864e8bc-d595-43b3-96ed-74d603b723f1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Deleting offline snapshot f864e8bc-d595-43b3-96ed-74d603b723f1 of volume 42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] snapshot_file for this snap is: volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3ffec2-0f7e-47c3-937e-d0356c26a589]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:54:59 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15" returned: 0 in 0.243s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:54:59 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 Nov 06 19:54:59 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:54:59 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:00 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.info Nov 06 19:55:00 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:00 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.info" returned: 0 in 0.251s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:00 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.info is being set with open permissions: ugo+rw Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:00 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1" returned: 0 in 0.379s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d1f397-b144-407e-bccc-5ad0545fde6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:00 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.info Nov 06 19:55:00 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8935b67f-f5d6-4c62-bce0-4bb95d40b8d8]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:00 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c Nov 06 19:55:00 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:00 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.info" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.370s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot 648381ca-7926-4003-b90a-703fc0d680ca of volume 7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:00 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c19040f1-9544-452c-b040-df0c0db3daa9 tempest-ProjectReaderTests-502416004 None] Create snapshot completed successfully Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c61094-42a4-4234-a10f-10afa2b416ea]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:00 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 Nov 06 19:55:00 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-b41d82c6-06a4-4770-a22c-2f92eb131f15-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Lock "cinder-b41d82c6-06a4-4770-a22c-2f92eb131f15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-f7c013f5-5b64-412f-8d08-dc70f1447fa8" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-f7c013f5-5b64-412f-8d08-dc70f1447fa8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-b41d82c6-06a4-4770-a22c-2f92eb131f15" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-b41d82c6-06a4-4770-a22c-2f92eb131f15" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Deleting offline snapshot b41d82c6-06a4-4770-a22c-2f92eb131f15 of volume f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] snapshot_file for this snap is: volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a688473e-3b91-46f5-bf9e-aeddb16479f4]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:00 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c" returned: 0 in 0.582s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:00 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 Nov 06 19:55:00 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:00 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 Nov 06 19:55:00 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:00 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41" returned: 0 in 0.447s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:00 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:01 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca 1G Nov 06 19:55:01 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:01 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1" returned: 0 in 0.366s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:01 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:01 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1 Nov 06 19:55:01 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5bd244-e705-41e3-91ae-000a8be55973]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:01 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 Nov 06 19:55:01 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:01 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca 1G" returned: 0 in 0.411s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c263779-2a82-4a96-882b-955f75a04c41 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:01 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c263779-2a82-4a96-882b-955f75a04c41 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca Nov 06 19:55:01 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:01 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c.f864e8bc-d595-43b3-96ed-74d603b723f1" returned: 0 in 0.288s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-f864e8bc-d595-43b3-96ed-74d603b723f1" released by "_delete_snapshot" :: held 1.736s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-42d1f397-b144-407e-bccc-5ad0545fde6c" released by "delete_snapshot" :: held 1.757s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Created reservations ['e1402e12-717f-4681-9bf1-4384de367cb9', '5547553d-9bcc-4f5d-801f-f957de82ac58', '6780d233-27e4-4e6f-bc98-223a7a1d9657', '25eabff8-458a-4285-b2a4-0f0ef2cbcb5d'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:01 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8" returned: 0 in 0.399s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:01 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Delete snapshot completed successfully. Nov 06 19:55:01 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 Nov 06 19:55:01 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-4c59df30-f402-4b92-8b81-89aa3e6d7c93 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-f864e8bc-d595-43b3-96ed-74d603b723f1-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:01 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c263779-2a82-4a96-882b-955f75a04c41 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca" returned: 0 in 0.324s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:01 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca is being set with open permissions: ugo+rw Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:01 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca Nov 06 19:55:01 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-42d1f397-b144-407e-bccc-5ad0545fde6c-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:01 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-42d1f397-b144-407e-bccc-5ad0545fde6c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:02 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca" returned: 0 in 0.300s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-quobyte-42d1f397-b144-407e-bccc-5ad0545fde6c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:02 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-42d1f397-b144-407e-bccc-5ad0545fde6c" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e68c9d-bd03-457e-8ce6-50917d2c060f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:02 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.info Nov 06 19:55:02 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15" returned: 0 in 0.463s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:02 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15 Nov 06 19:55:02 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:02 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c Nov 06 19:55:02 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:02 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.info" returned: 0 in 0.278s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:02 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.info is being set with open permissions: ugo+rw Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:02 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8.b41d82c6-06a4-4770-a22c-2f92eb131f15" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:02 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.info Nov 06 19:55:02 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-b41d82c6-06a4-4770-a22c-2f92eb131f15" released by "_delete_snapshot" :: held 1.651s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-f7c013f5-5b64-412f-8d08-dc70f1447fa8" released by "delete_snapshot" :: held 1.686s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:02 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c" returned: 0 in 0.376s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:02 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c Nov 06 19:55:02 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Created reservations ['937a2de3-6b98-4e3f-9d2d-ec9389788d46', '1595b548-a260-47cd-a6ba-c95fb7d2c43d', '8cd2b638-e179-4627-96f5-30af54e45e77', 'cb24b17a-8c4c-42af-8ec3-bdb8dba589e0'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Delete snapshot completed successfully. Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-10aace74-23ab-43f8-9946-0a3eb4b8cf4f tempest-ProjectReaderTests-502416004 None] Lock "cinder-b41d82c6-06a4-4770-a22c-2f92eb131f15-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:02 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.info" returned: 0 in 0.291s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.253s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206853913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b972299-8653-4e5f-af50-c291a7eecf99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:54:53Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Creating volume 6b972299-8653-4e5f-af50-c291a7eecf99 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:02 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:02 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 1073741824 Nov 06 19:55:02 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:02 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-3d5c710c-7c12-4aa1-8419-b200a64f8047 tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:55:02 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-42d1f397-b144-407e-bccc-5ad0545fde6c" returned: 0 in 0.297s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-42d1f397-b144-407e-bccc-5ad0545fde6c" released by "delete_volume" :: held 0.752s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Created reservations ['3b771bb3-f865-4fc9-bbdc-39dd9384fefd', '98dfff3e-1644-4d76-8713-37cef9bc1d99', '5c403907-1765-4875-a6d7-258eecdea77c', 'b9e18040-c47e-4dfb-b6f0-c530f9e43124'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-f7c013f5-5b64-412f-8d08-dc70f1447fa8-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Lock "cinder-f7c013f5-5b64-412f-8d08-dc70f1447fa8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:02 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-f7c013f5-5b64-412f-8d08-dc70f1447fa8" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:03 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:03 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-f7c013f5-5b64-412f-8d08-dc70f1447fa8" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a81cc6-b668-44ed-929d-c9dd6edb986c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-63d22474-a903-4374-980e-37b1b3cac399-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-63d22474-a903-4374-980e-37b1b3cac399-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:03 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 Nov 06 19:55:03 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "cinder-quobyte-63d22474-a903-4374-980e-37b1b3cac399" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-63d22474-a903-4374-980e-37b1b3cac399" acquired by "delete_volume" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:03 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 1073741824" returned: 0 in 0.600s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[77266532-35bd-4904-9512-2e2358114398]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:03 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.341s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Deleted volume successfully. Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-71485129-3b33-4a3a-bb2e-b42891949265 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-42d1f397-b144-407e-bccc-5ad0545fde6c-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:03 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 Nov 06 19:55:03 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:03 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 Nov 06 19:55:03 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:03 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8" returned: 0 in 0.511s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:03 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8 Nov 06 19:55:03 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:03 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99" returned: 0 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a133a2-0436-4007-8ceb-b4385cfd5d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b972299-8653-4e5f-af50-c291a7eecf99', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21234878-91a6-4894-8525-eada5022ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-648381ca-7926-4003-b90a-703fc0d680ca-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:03 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Volume volume-6b972299-8653-4e5f-af50-c291a7eecf99 (6b972299-8653-4e5f-af50-c291a7eecf99): created successfully Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21234878-91a6-4894-8525-eada5022ede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (e35f9ad1-2ef9-4e2a-98a6-3589e528111c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-648381ca-7926-4003-b90a-703fc0d680ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-7c263779-2a82-4a96-882b-955f75a04c41" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:03 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399" returned: 0 in 0.471s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:03 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d777de17-86c1-4e11-b655-e4204a9fb804 tempest-ProjectReaderTests-525116888 None] Created volume successfully. Nov 06 19:55:03 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399 Nov 06 19:55:03 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-7c263779-2a82-4a96-882b-955f75a04c41" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-648381ca-7926-4003-b90a-703fc0d680ca" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-648381ca-7926-4003-b90a-703fc0d680ca" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot 648381ca-7926-4003-b90a-703fc0d680ca of volume 7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb64aef-7198-4ae7-9cc0-dc5935ffaac6]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:03 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-f7c013f5-5b64-412f-8d08-dc70f1447fa8" returned: 0 in 0.310s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-f7c013f5-5b64-412f-8d08-dc70f1447fa8" released by "delete_volume" :: held 0.896s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:03 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Created reservations ['c46e130d-3828-44ad-9afb-bbd63faac3f6', '7b633a68-8b78-4fb6-90c9-03e6095b7088', 'aba485a5-5454-48a3-8fd9-2af84771bb35', '706e9e91-989a-4ad1-a933-a1c42864aa0e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:04 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca Nov 06 19:55:04 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:04 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:04 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:04 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-63d22474-a903-4374-980e-37b1b3cac399" returned: 0 in 0.340s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-quobyte-63d22474-a903-4374-980e-37b1b3cac399" released by "delete_volume" :: held 0.881s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-6b972299-8653-4e5f-af50-c291a7eecf99-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Lock "cinder-6b972299-8653-4e5f-af50-c291a7eecf99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Created reservations ['fee70843-619b-4ace-b7f5-70080be598ea', '3e8a1525-1019-4b6c-ab61-23fa9e562ae1', '96b64dd0-6b17-4c7c-b549-8c919a08aed6', '884cfe43-6e86-4a1c-bf6c-cfa4be5b7bc0'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-quobyte-6b972299-8653-4e5f-af50-c291a7eecf99" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-6b972299-8653-4e5f-af50-c291a7eecf99" acquired by "delete_volume" :: waited 0.033s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:04 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafbf79b-45c9-428b-8d7f-36ebc77c7fa5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca" returned: 0 in 0.500s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c263779-2a82-4a96-882b-955f75a04c41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ffc3fd-2079-47b8-94e9-6fe36937b411]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:04 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:04 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:04 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.438s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:04 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 Nov 06 19:55:04 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Deleted volume successfully. Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d4e6bc4-820d-4b4a-8d21-7f033d1e90e6 tempest-ProjectReaderTests-502416004 None] Lock "cinder-f7c013f5-5b64-412f-8d08-dc70f1447fa8-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:04 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 Nov 06 19:55:04 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:04 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.452s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:04 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:04 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Deleted volume successfully. Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99" returned: 0 in 0.562s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:04 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:04 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99 Nov 06 19:55:04 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (77a69645-4cc8-44b2-8921-92db124a26b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3719df-7703-4335-8161-939d8753b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-be2ed700-d279-4026-9d80-129472738d18 tempest-SnapshotDependencyTests-444248877 None] Lock "cinder-63d22474-a903-4374-980e-37b1b3cac399-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3719df-7703-4335-8161-939d8753b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433360098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:05Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0838f8-09d6-4c93-bcce-e7bd336ffe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0838f8-09d6-4c93-bcce-e7bd336ffe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aaf475-d304-49c9-b885-d4038ad64fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97aaf475-d304-49c9-b885-d4038ad64fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f', 'volume_name': 'volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acf18cd-f0db-4939-bed0-e06631e79a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5acf18cd-f0db-4939-bed0-e06631e79a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ef9ea1-ab07-4320-90d3-2f66b72c2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:05 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Volume c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f', 'volume_size': 1} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433360098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:05Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Creating volume c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:05 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:05 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41" returned: 0 in 0.665s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:05 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f 1073741824 Nov 06 19:55:05 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:05 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca Nov 06 19:55:05 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:05 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-6b972299-8653-4e5f-af50-c291a7eecf99" returned: 0 in 0.336s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-6b972299-8653-4e5f-af50-c291a7eecf99" released by "delete_volume" :: held 0.955s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Created reservations ['c79d0123-a8ae-4e7a-b9f6-cc95af45c58e', '1a898818-7cdc-4404-8a0b-55cd6ecf7e31', '2962aa75-db44-4d01-9f60-0827e0aea850', '832daf7c-008b-45e0-b5b7-ab67456e800c'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:05 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:05 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:05 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca" returned: 0 in 0.469s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:05 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca Nov 06 19:55:05 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:05 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f 1073741824" returned: 0 in 0.577s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:05 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f Nov 06 19:55:05 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:05 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.301s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:05 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Deleted volume successfully. Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-72621726-02a2-4a8e-9491-adf949517366 tempest-ProjectReaderTests-525116888 None] Lock "cinder-6b972299-8653-4e5f-af50-c291a7eecf99-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:05 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41.648381ca-7926-4003-b90a-703fc0d680ca" returned: 0 in 0.319s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-648381ca-7926-4003-b90a-703fc0d680ca" released by "_delete_snapshot" :: held 2.079s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:05 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-7c263779-2a82-4a96-882b-955f75a04c41" released by "delete_snapshot" :: held 2.107s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Created reservations ['c13185d1-a97b-4288-b6b6-cacdf6a6dc04', '7d4dbc64-2e32-4a75-9622-b0dc08fcfae2', '3ad980aa-ff07-4fff-a966-713959d3e515', '3f75c098-a9cc-439b-b7f4-537764fe5df8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:06 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" returned: 0 in 0.311s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ef9ea1-ab07-4320-90d3-2f66b72c2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468eb970-abf8-499f-aea0-da8ce0ba2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:06 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Volume volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f (c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f): created successfully Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468eb970-abf8-499f-aea0-da8ce0ba2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (77a69645-4cc8-44b2-8921-92db124a26b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d4433eb1-b9be-4349-9eca-dccc3c8e4871 tempest-ProjectReaderTests-502416004 None] Created volume successfully. Nov 06 19:55:06 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-6d1680bb-5792-4896-8017-7d19316de3f9 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-648381ca-7926-4003-b90a-703fc0d680ca-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (a5406de5-afb8-4a1c-9456-7c97a82dbc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70832175-9aec-4ee0-ab12-2db728d1b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:06 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-7c263779-2a82-4a96-882b-955f75a04c41-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70832175-9aec-4ee0-ab12-2db728d1b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199077085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e60bf6-15cd-48ca-a9fa-7e6c51582b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:07Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae16931f-dd3b-447c-9862-7aa9319c88e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae16931f-dd3b-447c-9862-7aa9319c88e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44fe788-7428-4fb0-a3ac-f5410a73a854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44fe788-7428-4fb0-a3ac-f5410a73a854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e60bf6-15cd-48ca-a9fa-7e6c51582b09', 'volume_name': 'volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bfbcff-ce96-44ef-a272-b9e027d69a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bfbcff-ce96-44ef-a272-b9e027d69a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e5f06b-dea9-4967-b89b-c4eb3ade5f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:07 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Volume e2e60bf6-15cd-48ca-a9fa-7e6c51582b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09', 'volume_size': 1} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199077085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e60bf6-15cd-48ca-a9fa-7e6c51582b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:07Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Creating volume e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:07 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-7c263779-2a82-4a96-882b-955f75a04c41-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:07 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 1073741824 Nov 06 19:55:07 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-7c263779-2a82-4a96-882b-955f75a04c41" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-7c263779-2a82-4a96-882b-955f75a04c41" acquired by "delete_volume" :: waited 0.032s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b7282c-86c4-4323-9be8-7cbf9d99ce8c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:07 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 Nov 06 19:55:07 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:07 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 1073741824" returned: 0 in 0.569s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:07 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41" returned: 0 in 0.430s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:07 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 Nov 06 19:55:07 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:07 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41 Nov 06 19:55:07 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:07 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09" returned: 0 in 0.255s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:07 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.633s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-7c263779-2a82-4a96-882b-955f75a04c41" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Creating offline snapshot ec228b86-0f32-407d-953e-1eeeb8be1550 of volume c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:07 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-7c263779-2a82-4a96-882b-955f75a04c41" released by "delete_volume" :: held 0.800s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e5f06b-dea9-4967-b89b-c4eb3ade5f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c57ba1a-5ab4-484f-b2f8-0382f784f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[57633a73-458a-4699-8351-51d9d1bf1a47]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:08 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Volume volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 (e2e60bf6-15cd-48ca-a9fa-7e6c51582b09): created successfully Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c57ba1a-5ab4-484f-b2f8-0382f784f319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (a5406de5-afb8-4a1c-9456-7c97a82dbc9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-fd3e55b1-bb88-4b7f-a6a9-603979a1a483 tempest-ProjectReaderTests-525116888 None] Created volume successfully. Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Created reservations ['a5f5f60f-d1b0-4ea8-895a-94b6c940ad6f', 'b22cb424-24e6-4591-9ebf-d6665b808a91', '730add8c-07bd-44ee-aa90-f49b874352d8', '14ccb16d-838b-48d7-954a-67ae72e1ecd1'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:08 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f Nov 06 19:55:08 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:08 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:08 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:08 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" returned: 0 in 0.386s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:08 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 1G Nov 06 19:55:08 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:08 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.283s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:08 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-544a6751-8458-4945-ba78-40df0eea1710 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-7c263779-2a82-4a96-882b-955f75a04c41-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:08 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 1G" returned: 0 in 0.489s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:08 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:08 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 Nov 06 19:55:08 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Lock "cinder-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-quobyte-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09" acquired by "delete_volume" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c255c7-8f9f-4159-91d0-18fbd4b20371]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:09 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550" returned: 0 in 0.383s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:09 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 is being set with open permissions: ugo+rw Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:09 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 Nov 06 19:55:09 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:09 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 Nov 06 19:55:09 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:09 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550" returned: 0 in 0.334s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:09 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.info Nov 06 19:55:09 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:09 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09" returned: 0 in 0.521s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:09 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09 Nov 06 19:55:09 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (efe0c6a3-2dd6-4d71-a430-86e15ce79d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb92fb3-827c-4a49-98b5-f1b4c2eaf5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb92fb3-827c-4a49-98b5-f1b4c2eaf5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357077470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb23129-e44a-4987-bc99-44d28f49756e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:10Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642b1b4d-18a7-4fba-9a0a-78ac6c9c69d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642b1b4d-18a7-4fba-9a0a-78ac6c9c69d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d98825-40e2-452a-817b-e210cfe6b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d98825-40e2-452a-817b-e210cfe6b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb23129-e44a-4987-bc99-44d28f49756e', 'volume_name': 'volume-dbb23129-e44a-4987-bc99-44d28f49756e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d81cab5-bd93-41e1-9726-94e072346777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d81cab5-bd93-41e1-9726-94e072346777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fc7306-ce80-4488-9bc3-505aba24a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:09 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Volume dbb23129-e44a-4987-bc99-44d28f49756e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb23129-e44a-4987-bc99-44d28f49756e', 'volume_size': 1} Nov 06 19:55:09 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.info" returned: 0 in 0.338s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:09 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.info is being set with open permissions: ugo+rw Nov 06 19:55:09 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:10 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.info Nov 06 19:55:10 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:10 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09" returned: 0 in 0.342s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09" released by "delete_volume" :: held 0.912s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Created reservations ['e7b062c9-5d7a-49e0-8973-28376a7a6c67', '4aa4463d-8ce9-49ee-b5ba-0a993dd87990', '9980792f-a049-4a9a-80c2-7513dc9e7883', 'ac071590-d091-417b-ba7f-1afb5c522ff7'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:10 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.info" returned: 0 in 0.294s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:10 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:10 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357077470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb23129-e44a-4987-bc99-44d28f49756e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:10Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Creating volume dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:10 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:10 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e 1073741824 Nov 06 19:55:10 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f77911ba-f883-4053-80a0-a2ba3d3bac88 tempest-ProjectReaderTests-502416004 None] Create snapshot completed successfully Nov 06 19:55:10 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.288s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:10 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Deleted volume successfully. Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-f768e0b1-e3d7-41b3-a2ce-f78849b778d4 tempest-ProjectReaderTests-525116888 None] Lock "cinder-e2e60bf6-15cd-48ca-a9fa-7e6c51582b09-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (c3ba52a4-ad91-456b-b786-3daf402729b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae95bf5c-af65-4dbb-8786-5c062ab41d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:10 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e 1073741824" returned: 0 in 0.611s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae95bf5c-af65-4dbb-8786-5c062ab41d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380811979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223dc59d-86d3-4b96-a9c7-ec5367eb48cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:11Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77170401-b6bc-406e-ad3b-f4bed96db028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77170401-b6bc-406e-ad3b-f4bed96db028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59807ca5-6be7-4833-9d83-24d2f6ae605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59807ca5-6be7-4833-9d83-24d2f6ae605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223dc59d-86d3-4b96-a9c7-ec5367eb48cf', 'volume_name': 'volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561258df-eae3-4016-ac11-927e836afee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561258df-eae3-4016-ac11-927e836afee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3746b04-6ba2-4b01-ad7d-927183c24c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:10 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Volume 223dc59d-86d3-4b96-a9c7-ec5367eb48cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf', 'volume_size': 1} Nov 06 19:55:10 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:11 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e Nov 06 19:55:11 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:11 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e" returned: 0 in 0.251s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.287s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380811979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223dc59d-86d3-4b96-a9c7-ec5367eb48cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c851971ae74737931480c604b06195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:11Z,use_quota=True,user_id='3c48fc98aa5c452bb3ce521cbf07d795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Creating volume 223dc59d-86d3-4b96-a9c7-ec5367eb48cf {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:11 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fc7306-ce80-4488-9bc3-505aba24a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb23129-e44a-4987-bc99-44d28f49756e', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:11 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf 1073741824 Nov 06 19:55:11 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a5c79c-501c-4970-b88c-455d333224f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:11 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Volume volume-dbb23129-e44a-4987-bc99-44d28f49756e (dbb23129-e44a-4987-bc99-44d28f49756e): created successfully Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a5c79c-501c-4970-b88c-455d333224f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (efe0c6a3-2dd6-4d71-a430-86e15ce79d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:11 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-8b283e47-3f93-4680-9cff-acd5b962823d tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-ec228b86-0f32-407d-953e-1eeeb8be1550-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Lock "cinder-ec228b86-0f32-407d-953e-1eeeb8be1550-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-ec228b86-0f32-407d-953e-1eeeb8be1550" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-ec228b86-0f32-407d-953e-1eeeb8be1550" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Deleting offline snapshot ec228b86-0f32-407d-953e-1eeeb8be1550 of volume c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] snapshot_file for this snap is: volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[92210d35-b409-48fc-a649-84c82ba7d672]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:11 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf 1073741824" returned: 0 in 0.514s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:11 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 Nov 06 19:55:11 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:11 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:11 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf Nov 06 19:55:11 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:12 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550" returned: 0 in 0.662s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b4574f-0d33-44b3-9f10-9ff0e7d791ac]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:12 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf" returned: 0 in 0.547s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.066s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot a5910c46-404c-4449-88de-dd07a6f0e77a of volume dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3746b04-6ba2-4b01-ad7d-927183c24c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014f3a02-0491-4f27-afcf-675443008045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f73fd3-07ec-4a68-99e7-a24d13ca5351]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:12 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Volume volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf (223dc59d-86d3-4b96-a9c7-ec5367eb48cf): created successfully Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014f3a02-0491-4f27-afcf-675443008045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:12 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Flow 'volume_create_manager' (c3ba52a4-ad91-456b-b786-3daf402729b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:12 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-703cf058-9ddd-4b3b-bab9-e569ceee645a tempest-ProjectReaderTests-525116888 None] Created volume successfully. Nov 06 19:55:12 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f Nov 06 19:55:12 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:12 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e Nov 06 19:55:12 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" returned: 0 in 0.631s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:13 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e" returned: 0 in 0.544s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:13 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 Nov 06 19:55:13 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a 1G Nov 06 19:55:13 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-223dc59d-86d3-4b96-a9c7-ec5367eb48cf-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Lock "cinder-223dc59d-86d3-4b96-a9c7-ec5367eb48cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Acquiring lock "cinder-quobyte-223dc59d-86d3-4b96-a9c7-ec5367eb48cf" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-223dc59d-86d3-4b96-a9c7-ec5367eb48cf" acquired by "delete_volume" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d538d160-b0ac-40f6-bc35-bd3e525346d3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:13 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf Nov 06 19:55:13 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550" returned: 0 in 0.399s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:13 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550 Nov 06 19:55:13 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a 1G" returned: 0 in 0.524s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb23129-e44a-4987-bc99-44d28f49756e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:13 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb23129-e44a-4987-bc99-44d28f49756e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a Nov 06 19:55:13 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf" returned: 0 in 0.434s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:13 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf Nov 06 19:55:13 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f.ec228b86-0f32-407d-953e-1eeeb8be1550" returned: 0 in 0.284s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-ec228b86-0f32-407d-953e-1eeeb8be1550" released by "_delete_snapshot" :: held 2.094s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" released by "delete_snapshot" :: held 2.122s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Created reservations ['c34d5423-7fe4-43fd-a9b7-70c43bad5748', '8a337945-d928-4d0e-88f4-7de766c5bc5f', '678631d1-665d-46f2-9352-26aa8e680cb7', '52c17809-3172-48cf-a09a-2053aab6689e'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:13 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Delete snapshot completed successfully. Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-a45e7880-b48b-43fe-90fa-6f5bbb2faf5c tempest-ProjectReaderTests-502416004 None] Lock "cinder-ec228b86-0f32-407d-953e-1eeeb8be1550-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:13 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb23129-e44a-4987-bc99-44d28f49756e -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a" returned: 0 in 0.355s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a is being set with open permissions: ugo+rw Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:13 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a Nov 06 19:55:13 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:13 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-223dc59d-86d3-4b96-a9c7-ec5367eb48cf" returned: 0 in 0.310s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:13 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Lock "cinder-quobyte-223dc59d-86d3-4b96-a9c7-ec5367eb48cf" released by "delete_volume" :: held 0.804s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Created reservations ['f00dad76-3ca6-4ca0-900d-80707d957966', 'e72f85a7-551a-48fc-b84a-0aa1e4f8dd64', '0c385095-47cb-4a12-96aa-f747e1d8209f', '9fc14426-9f8f-4b02-82a4-dd8705a3f82a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:14 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:14 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:14 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a" returned: 0 in 0.374s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:14 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.info Nov 06 19:55:14 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:14 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.349s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:14 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Deleted volume successfully. Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2381f9ab-bf36-4721-9531-5c7eb4874637 tempest-ProjectReaderTests-525116888 None] Lock "cinder-223dc59d-86d3-4b96-a9c7-ec5367eb48cf-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:14 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.info" returned: 0 in 0.398s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:14 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.info is being set with open permissions: ugo+rw Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:14 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.info Nov 06 19:55:14 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Lock "cinder-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:14 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" acquired by "delete_volume" :: waited 0.035s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4a1bc-f407-46b2-b447-d016217f26ec]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:15 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.info" returned: 0 in 0.387s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:15 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f Nov 06 19:55:15 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:15 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0be1f354-a4e6-4a7d-9259-03f526ef81bb tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:55:15 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" returned: 0 in 0.495s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-a5910c46-404c-4449-88de-dd07a6f0e77a-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:15 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f Nov 06 19:55:15 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-a5910c46-404c-4449-88de-dd07a6f0e77a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-dbb23129-e44a-4987-bc99-44d28f49756e" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-dbb23129-e44a-4987-bc99-44d28f49756e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-a5910c46-404c-4449-88de-dd07a6f0e77a" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-a5910c46-404c-4449-88de-dd07a6f0e77a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot a5910c46-404c-4449-88de-dd07a6f0e77a of volume dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1b36b9-7e03-4f4b-9f71-06a5aa13f50b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:15 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a Nov 06 19:55:15 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:15 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" returned: 0 in 0.374s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:15 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f" released by "delete_volume" :: held 0.961s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Created reservations ['325d37df-cd4b-457b-999e-5f9943eb7b9d', 'd862ec00-eac0-44c2-b483-2fbc25e3cbe4', '23d08ea3-8ded-4ab2-a88e-0d7bce48c772', '5072c1de-c9af-4f00-93ca-0ec06b75f847'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:16 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:16 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:16 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a" returned: 0 in 0.530s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbb23129-e44a-4987-bc99-44d28f49756e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfee5f5-3e87-4508-a7f1-5d2ad1ad203a]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:16 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e Nov 06 19:55:16 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:16 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.348s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:16 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Deleted volume successfully. Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-0ca0fef7-2814-4719-8465-92a7def67bdf tempest-ProjectReaderTests-502416004 None] Lock "cinder-c5ac5ae8-e87f-4e96-bf1d-f6f36ef7a94f-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:16 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e" returned: 0 in 0.426s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:16 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:16 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a Nov 06 19:55:16 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:17 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a" returned: 0 in 0.389s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:17 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a Nov 06 19:55:17 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:17 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e.a5910c46-404c-4449-88de-dd07a6f0e77a" returned: 0 in 0.279s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-a5910c46-404c-4449-88de-dd07a6f0e77a" released by "_delete_snapshot" :: held 1.740s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-dbb23129-e44a-4987-bc99-44d28f49756e" released by "delete_snapshot" :: held 1.778s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Created reservations ['b213aa40-7b75-4637-a128-7aacd75b5c50', '0e44be3c-97e3-4ce9-8934-98a3d06aa249', '7723e2ac-e11c-418f-be5d-7deb930d6af8', 'aa2d71f5-9b9f-48ea-85f3-64ec0a63a340'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:17 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-9c13b8ac-9702-41d2-a8b9-11be840adc7d tempest-ProjectMemberTests-1241856426 None] Lock "cinder-a5910c46-404c-4449-88de-dd07a6f0e77a-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-dbb23129-e44a-4987-bc99-44d28f49756e-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-dbb23129-e44a-4987-bc99-44d28f49756e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-dbb23129-e44a-4987-bc99-44d28f49756e" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-dbb23129-e44a-4987-bc99-44d28f49756e" acquired by "delete_volume" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c847c65-8172-4a58-9d38-53f876146362]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (9e54b13e-6e06-4c61-9707-2bd40299d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:17 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce76bed2-9df7-4eb3-9835-1c5a1ec30e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce76bed2-9df7-4eb3-9835-1c5a1ec30e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944298771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c01356a-35b0-4889-9d73-d1ee0da1338c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:18Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919573ce-d964-48b3-b8a1-6dd635cea5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919573ce-d964-48b3-b8a1-6dd635cea5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddde112d-1090-4d1c-a5f0-b9c763b5e51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddde112d-1090-4d1c-a5f0-b9c763b5e51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c01356a-35b0-4889-9d73-d1ee0da1338c', 'volume_name': 'volume-5c01356a-35b0-4889-9d73-d1ee0da1338c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b99834f-e21e-412c-ba2d-5f220c69308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b99834f-e21e-412c-ba2d-5f220c69308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910dbb88-cee3-46e1-9057-f106415babe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Volume 5c01356a-35b0-4889-9d73-d1ee0da1338c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c01356a-35b0-4889-9d73-d1ee0da1338c', 'volume_size': 1} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944298771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c01356a-35b0-4889-9d73-d1ee0da1338c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:18Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Creating volume 5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:18 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e Nov 06 19:55:18 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:18 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:18 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c 1073741824 Nov 06 19:55:18 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:18 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e" returned: 0 in 0.365s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:18 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e Nov 06 19:55:18 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:18 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c 1073741824" returned: 0 in 0.425s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:18 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c Nov 06 19:55:18 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:18 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-dbb23129-e44a-4987-bc99-44d28f49756e" returned: 0 in 0.281s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-dbb23129-e44a-4987-bc99-44d28f49756e" released by "delete_volume" :: held 0.724s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Created reservations ['39220207-92eb-4fa4-a820-e36cca1e6725', 'b7252ac6-bc66-40ff-b54c-36bc4ce80f28', '879afd00-7be8-47c4-8633-5e3d91d4b8b4', '3de2af6a-aca1-46e7-9aef-0f5d94f29ef8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:18 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:18 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:18 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910dbb88-cee3-46e1-9057-f106415babe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c01356a-35b0-4889-9d73-d1ee0da1338c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9e0be9-269a-4446-84ba-dc1b2b774fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:18 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Volume volume-5c01356a-35b0-4889-9d73-d1ee0da1338c (5c01356a-35b0-4889-9d73-d1ee0da1338c): created successfully Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9e0be9-269a-4446-84ba-dc1b2b774fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (9e54b13e-6e06-4c61-9707-2bd40299d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:18 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-1f9352a5-caad-4208-820e-549694f47a17 tempest-ProjectReaderTests-502416004 None] Created volume successfully. Nov 06 19:55:18 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:18 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:18 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-39dfeaed-7ff4-4362-80ca-d880501ec325 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-dbb23129-e44a-4987-bc99-44d28f49756e-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Creating offline snapshot 401fda96-8a6a-416a-8bff-70b593417dcc of volume 5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c27c36a-69fc-4469-b3fe-282025808a95]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:19 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c Nov 06 19:55:19 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (3115f54c-6e4c-409b-896d-ad6526f4c300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf84227-5c82-4045-90ac-9d4a6a7f03db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf84227-5c82-4045-90ac-9d4a6a7f03db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-635310828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fb9756-7cce-4e98-89f3-d1741177b728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:19Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19049bed-50d7-4f67-b122-d7f1b66c0315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19049bed-50d7-4f67-b122-d7f1b66c0315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1959f0-e808-4ea5-b9ff-3a81b8d62a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1959f0-e808-4ea5-b9ff-3a81b8d62a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20fb9756-7cce-4e98-89f3-d1741177b728', 'volume_name': 'volume-20fb9756-7cce-4e98-89f3-d1741177b728', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb8f963-9581-4a0a-9b4b-fc3f79f22597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb8f963-9581-4a0a-9b4b-fc3f79f22597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c5fe3-3ab3-4a3a-ab10-2e246c8ca2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:19 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Volume 20fb9756-7cce-4e98-89f3-d1741177b728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20fb9756-7cce-4e98-89f3-d1741177b728', 'volume_size': 1} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:19 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c" returned: 0 in 0.432s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:19 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:19 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc 1G Nov 06 19:55:19 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:20 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc 1G" returned: 0 in 0.394s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c01356a-35b0-4889-9d73-d1ee0da1338c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:20 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c01356a-35b0-4889-9d73-d1ee0da1338c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc Nov 06 19:55:20 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:20 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c01356a-35b0-4889-9d73-d1ee0da1338c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:20 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc is being set with open permissions: ugo+rw Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:20 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc Nov 06 19:55:20 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:20 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:20 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.info Nov 06 19:55:20 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:20 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.info" returned: 0 in 0.243s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:20 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.info is being set with open permissions: ugo+rw Nov 06 19:55:20 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:20 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.info Nov 06 19:55:20 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:21 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.info" returned: 0 in 0.232s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-635310828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fb9756-7cce-4e98-89f3-d1741177b728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:19Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Creating volume 20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:21 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:21 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 1073741824 Nov 06 19:55:21 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ea05cdfb-1c2e-4514-bc81-6be9e759f985 tempest-ProjectReaderTests-502416004 None] Create snapshot completed successfully Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-401fda96-8a6a-416a-8bff-70b593417dcc-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Lock "cinder-401fda96-8a6a-416a-8bff-70b593417dcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-5c01356a-35b0-4889-9d73-d1ee0da1338c" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-5c01356a-35b0-4889-9d73-d1ee0da1338c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-401fda96-8a6a-416a-8bff-70b593417dcc" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-401fda96-8a6a-416a-8bff-70b593417dcc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Deleting offline snapshot 401fda96-8a6a-416a-8bff-70b593417dcc of volume 5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] snapshot_file for this snap is: volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b58ed83-3de0-414c-98da-bd8c63c3e948]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:21 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc Nov 06 19:55:21 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:21 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 1073741824" returned: 0 in 0.492s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:21 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 Nov 06 19:55:21 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:21 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc" returned: 0 in 0.406s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c01356a-35b0-4889-9d73-d1ee0da1338c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99dd1c0-1e3f-4569-9628-a8e07cd8b448]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:21 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728" returned: 0 in 0.251s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c5fe3-3ab3-4a3a-ab10-2e246c8ca2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20fb9756-7cce-4e98-89f3-d1741177b728', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e4d7c4-4b97-473a-a240-7f1b88633874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:21 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Volume volume-20fb9756-7cce-4e98-89f3-d1741177b728 (20fb9756-7cce-4e98-89f3-d1741177b728): created successfully Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e4d7c4-4b97-473a-a240-7f1b88633874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:21 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (3115f54c-6e4c-409b-896d-ad6526f4c300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:21 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-edb7840d-d5b7-4ade-9926-24b6e9938321 tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:55:21 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c Nov 06 19:55:21 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:22 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c" returned: 0 in 0.362s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:22 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc Nov 06 19:55:22 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:22 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc" returned: 0 in 0.322s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:22 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc Nov 06 19:55:22 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot 59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 of volume 20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:22 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c.401fda96-8a6a-416a-8bff-70b593417dcc" returned: 0 in 0.269s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[6947a5b2-ffe8-4f44-8bfd-e94259eae6c2]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-401fda96-8a6a-416a-8bff-70b593417dcc" released by "_delete_snapshot" :: held 1.467s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-5c01356a-35b0-4889-9d73-d1ee0da1338c" released by "delete_snapshot" :: held 1.492s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Created reservations ['7292664a-6744-4c99-9e17-a3e7fff1ffed', 'd49c6ee3-bced-43d7-81a4-777c442012d2', '781f3904-31fb-4d7d-a894-42f2cb4a1100', '988eff18-7d9c-4338-85c5-108f91d7b386'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:22 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 Nov 06 19:55:22 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:22 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Delete snapshot completed successfully. Nov 06 19:55:22 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-48f57cff-e8a0-4169-af27-735aea4f9d19 tempest-ProjectReaderTests-502416004 None] Lock "cinder-401fda96-8a6a-416a-8bff-70b593417dcc-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:23 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728" returned: 0 in 0.375s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:23 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 1G Nov 06 19:55:23 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-5c01356a-35b0-4889-9d73-d1ee0da1338c-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Lock "cinder-5c01356a-35b0-4889-9d73-d1ee0da1338c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-5c01356a-35b0-4889-9d73-d1ee0da1338c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-5c01356a-35b0-4889-9d73-d1ee0da1338c" acquired by "delete_volume" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[3953d8e2-ca27-47d5-ba00-7d457f15762d]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:23 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 1G" returned: 0 in 0.448s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fb9756-7cce-4e98-89f3-d1741177b728 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:23 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fb9756-7cce-4e98-89f3-d1741177b728 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 Nov 06 19:55:23 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:23 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c Nov 06 19:55:23 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:23 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fb9756-7cce-4e98-89f3-d1741177b728 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" returned: 0 in 0.303s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:23 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 is being set with open permissions: ugo+rw Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:23 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 Nov 06 19:55:23 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:23 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c" returned: 0 in 0.387s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:23 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:24 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c Nov 06 19:55:24 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:24 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" returned: 0 in 0.258s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:24 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-5c01356a-35b0-4889-9d73-d1ee0da1338c" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:24 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.info Nov 06 19:55:24 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-5c01356a-35b0-4889-9d73-d1ee0da1338c" released by "delete_volume" :: held 0.714s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Created reservations ['7428bf76-bfc0-4dfd-ad7e-f5aeb4e8dce1', '1dbb83ac-d452-4f53-9fc1-db3953da5dcf', '754305af-9011-47e3-a8fe-b2d588e6c9f9', 'be2a8f19-b096-41ae-87fe-aa5f9aae47c8'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:24 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:24 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:24 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.info" returned: 0 in 0.263s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:24 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.info is being set with open permissions: ugo+rw Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:24 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.info Nov 06 19:55:24 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:24 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:24 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Deleted volume successfully. Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-35d3c232-ca7e-4e66-96d0-951b1271475d tempest-ProjectReaderTests-502416004 None] Lock "cinder-5c01356a-35b0-4889-9d73-d1ee0da1338c-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:24 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.info" returned: 0 in 0.276s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:24 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:24 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-86a0c3c9-1bcb-4d9d-a97c-3879dcb698c4 tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (aeef7deb-131c-4e23-9362-c033077c15f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b85f36-f73d-407b-ac80-8ea98c118c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b85f36-f73d-407b-ac80-8ea98c118c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906570678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1f9ddc-3030-44eb-8744-bb6ece3a07b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:25Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f9ca3-9790-4898-bdb0-2fc1b2823093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f9ca3-9790-4898-bdb0-2fc1b2823093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375677c7-4562-45e0-9065-37e40fb30349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375677c7-4562-45e0-9065-37e40fb30349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1f9ddc-3030-44eb-8744-bb6ece3a07b6', 'volume_name': 'volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86711db7-b20f-4aa2-b90f-3cfadaf26b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86711db7-b20f-4aa2-b90f-3cfadaf26b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e0c9c3-3cf1-47f1-8ce2-a9dc153dce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Volume cd1f9ddc-3030-44eb-8744-bb6ece3a07b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6', 'volume_size': 1} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906570678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1f9ddc-3030-44eb-8744-bb6ece3a07b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0197a78f1284a42a423a2bd1572fa30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:25Z,use_quota=True,user_id='2ac904efa17a4072b7e14e71a1708976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Creating volume cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:25 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:25 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 1073741824 Nov 06 19:55:25 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:25 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 1073741824" returned: 0 in 0.408s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:25 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 Nov 06 19:55:25 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:25 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e0c9c3-3cf1-47f1-8ce2-a9dc153dce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7492a0-31de-4bbd-adcd-3aa6afe0af0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:25 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Volume volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 (cd1f9ddc-3030-44eb-8744-bb6ece3a07b6): created successfully Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7492a0-31de-4bbd-adcd-3aa6afe0af0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Flow 'volume_create_manager' (aeef7deb-131c-4e23-9362-c033077c15f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:25 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ad588719-1bf6-4aa2-a150-4d0b9a20519b tempest-ProjectReaderTests-502416004 None] Created volume successfully. Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-20fb9756-7cce-4e98-89f3-d1741177b728" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-20fb9756-7cce-4e98-89f3-d1741177b728" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:25 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot 59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 of volume 20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9dc368-6719-4c73-932e-a53f716c29df]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:26 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 Nov 06 19:55:26 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Creating offline snapshot 36218591-c4d5-494e-bc4b-a0684b7f340b of volume cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c714c0-b5b4-401a-85d8-415acaea7dc0]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:26 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 Nov 06 19:55:26 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:26 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" returned: 0 in 0.400s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fb9756-7cce-4e98-89f3-d1741177b728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4405f7f-2420-4bf7-8e1d-410cd93cece3]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:26 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 Nov 06 19:55:26 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:26 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" returned: 0 in 0.380s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:26 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b 1G Nov 06 19:55:26 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:26 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728" returned: 0 in 0.357s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:26 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:26 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 Nov 06 19:55:26 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:27 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b 1G" returned: 0 in 0.403s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:27 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b Nov 06 19:55:27 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:27 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" returned: 0 in 0.371s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:27 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8 Nov 06 19:55:27 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:27 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b" returned: 0 in 0.318s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:27 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b is being set with open permissions: ugo+rw Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:27 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b Nov 06 19:55:27 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:27 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728.59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" returned: 0 in 0.277s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8" released by "_delete_snapshot" :: held 1.526s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-20fb9756-7cce-4e98-89f3-d1741177b728" released by "delete_snapshot" :: held 1.546s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Created reservations ['59da797b-fda4-4238-ad62-b82d01363767', '92ca1751-0d83-4395-b082-2d0451433bef', '14a02ec4-380c-446b-afa8-43e463dabba3', '89e982e7-2ce4-4988-b0ae-bb6e091cb5f3'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:27 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-aaa502d5-3dce-4ee5-bd57-f2171e263c14 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-59dc46a2-b5d3-43a4-9cc9-6c252f54c1c8-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:27 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b" returned: 0 in 0.260s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:27 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.info Nov 06 19:55:27 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:27 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.info" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:27 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.info is being set with open permissions: ugo+rw Nov 06 19:55:27 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:27 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.info Nov 06 19:55:27 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-20fb9756-7cce-4e98-89f3-d1741177b728-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-20fb9756-7cce-4e98-89f3-d1741177b728-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-20fb9756-7cce-4e98-89f3-d1741177b728" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:28 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.info" returned: 0 in 0.250s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-20fb9756-7cce-4e98-89f3-d1741177b728" acquired by "delete_volume" :: waited 0.038s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa09d4e-6b0d-4909-a329-8f76601a74d5]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:28 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-0bf4b7c4-ceb3-47c7-9b35-33be26734332 tempest-ProjectReaderTests-502416004 None] Create snapshot completed successfully Nov 06 19:55:28 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 Nov 06 19:55:28 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-36218591-c4d5-494e-bc4b-a0684b7f340b-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Lock "cinder-36218591-c4d5-494e-bc4b-a0684b7f340b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-36218591-c4d5-494e-bc4b-a0684b7f340b" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-36218591-c4d5-494e-bc4b-a0684b7f340b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Deleting offline snapshot 36218591-c4d5-494e-bc4b-a0684b7f340b of volume cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] snapshot_file for this snap is: volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[0348cf7a-e3f1-4658-96cc-8e3bf059e20e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:28 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b Nov 06 19:55:28 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:28 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728" returned: 0 in 0.387s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:28 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728 Nov 06 19:55:28 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:28 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b" returned: 0 in 0.368s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[863daa52-ce40-417d-80b7-e460dfcea25b]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:28 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-20fb9756-7cce-4e98-89f3-d1741177b728" returned: 0 in 0.254s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-20fb9756-7cce-4e98-89f3-d1741177b728" released by "delete_volume" :: held 0.706s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:28 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Created reservations ['d45fdcff-aab5-4483-9ca3-02c8cd6709c3', '15b7a9c6-0df7-4baf-91ac-9be8090f65b5', 'a901a390-e75a-44ec-bf8e-61a71ada7657', 'ce91fb21-b705-4a13-bfb0-b792aa9d8d00'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:28 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 Nov 06 19:55:28 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:29 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:29 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:29 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" returned: 0 in 0.390s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:29 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.265s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:29 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=258,cinder:SELECT=206,cinder:DELETE=21,cinder:INSERT=67 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:55:29 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b Nov 06 19:55:29 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-46bf5d80-50cf-4d88-8e10-15fc71c9d6d4 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-20fb9756-7cce-4e98-89f3-d1741177b728-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:29 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b" returned: 0 in 0.416s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:29 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b Nov 06 19:55:29 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=189,cinder:INSERT=69,cinder:UPDATE=258,cinder:DELETE=24 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (f7617db1-e2c2-4c0a-ae57-ae1b8fed61dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b0188a-0147-4de9-83e9-e51bbc9fd783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b0188a-0147-4de9-83e9-e51bbc9fd783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57054489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2970f6ad-cabf-4dda-936d-a06894dff8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:30Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac40478-d3ef-48ef-acaa-84d7bc4b6177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac40478-d3ef-48ef-acaa-84d7bc4b6177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1347f8d4-8e0a-4fb4-9b49-e3846d890053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1347f8d4-8e0a-4fb4-9b49-e3846d890053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2970f6ad-cabf-4dda-936d-a06894dff8eb', 'volume_name': 'volume-2970f6ad-cabf-4dda-936d-a06894dff8eb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546b12c6-c9ca-4a01-afee-7edac0d85932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546b12c6-c9ca-4a01-afee-7edac0d85932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa33b49-c1f1-4839-8df3-e88e458f2801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:29 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Volume 2970f6ad-cabf-4dda-936d-a06894dff8eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2970f6ad-cabf-4dda-936d-a06894dff8eb', 'volume_size': 1} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57054489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2970f6ad-cabf-4dda-936d-a06894dff8eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:30Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Creating volume 2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:29 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:29 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb 1073741824 Nov 06 19:55:29 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:29 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6.36218591-c4d5-494e-bc4b-a0684b7f340b" returned: 0 in 0.244s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-36218591-c4d5-494e-bc4b-a0684b7f340b" released by "_delete_snapshot" :: held 1.519s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:29 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" released by "delete_snapshot" :: held 1.543s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Created reservations ['cebd9186-1789-4a49-956e-35bbc09251c7', '7a4de432-53f3-423a-ac06-cc7b9876c75b', '2f45a1cc-d7bc-4f68-95a5-e70e4a26bbd2', 'e5faf4f5-d207-44f0-bb95-f527b9a45482'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Delete snapshot completed successfully. Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-c044221a-ff1c-4996-b7c0-58215983cab1 tempest-ProjectReaderTests-502416004 None] Lock "cinder-36218591-c4d5-494e-bc4b-a0684b7f340b-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:30 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb 1073741824" returned: 0 in 0.421s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:30 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb Nov 06 19:55:30 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:30 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb" returned: 0 in 0.257s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Lock "cinder-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa33b49-c1f1-4839-8df3-e88e458f2801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2970f6ad-cabf-4dda-936d-a06894dff8eb', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc1060-3028-4a1f-bac7-03cd57801a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:30 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Volume volume-2970f6ad-cabf-4dda-936d-a06894dff8eb (2970f6ad-cabf-4dda-936d-a06894dff8eb): created successfully Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc1060-3028-4a1f-bac7-03cd57801a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (f7617db1-e2c2-4c0a-ae57-ae1b8fed61dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Acquiring lock "cinder-quobyte-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:30 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-dc1fa574-406d-4835-9cc8-e625117e33e3 tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" acquired by "delete_volume" :: waited 0.022s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfa9418-f615-48ea-b6c7-c921a97d7f72]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:30 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 Nov 06 19:55:30 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot 8f386bd6-aa2b-4de2-a138-c5d72e19129e of volume 2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee8304a-8963-437b-a437-9d723422f91e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:30 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:31 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb Nov 06 19:55:31 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:31 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" returned: 0 in 0.379s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:31 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6 Nov 06 19:55:31 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:31 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb" returned: 0 in 0.362s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:31 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" returned: 0 in 0.253s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:31 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e 1G Nov 06 19:55:31 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Lock "cinder-quobyte-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6" released by "delete_volume" :: held 0.701s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Created reservations ['771074ef-d1b0-457a-a20d-17ccd4b09207', '6de18d8b-3b43-4bcd-8cf2-19accc4f6e50', '7f5522ef-d62a-4efe-9e76-89075620e178', '476121f3-7201-4892-8c4a-579e58e7838f'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:31 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:31 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:31 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.268s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:31 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e 1G" returned: 0 in 0.423s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2970f6ad-cabf-4dda-936d-a06894dff8eb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:31 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Deleted volume successfully. Nov 06 19:55:31 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2970f6ad-cabf-4dda-936d-a06894dff8eb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e Nov 06 19:55:31 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:31 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-19e3f0bc-f0a4-499f-ba99-b6ef6bf9328c tempest-ProjectReaderTests-502416004 None] Lock "cinder-cd1f9ddc-3030-44eb-8744-bb6ece3a07b6-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:32 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2970f6ad-cabf-4dda-936d-a06894dff8eb -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e" returned: 0 in 0.314s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:32 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e is being set with open permissions: ugo+rw Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:32 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e Nov 06 19:55:32 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:32 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e" returned: 0 in 0.256s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:32 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.info Nov 06 19:55:32 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:32 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.info" returned: 0 in 0.273s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:32 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.info is being set with open permissions: ugo+rw Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:32 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.info Nov 06 19:55:32 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:32 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.info" returned: 0 in 0.263s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:32 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:32 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-6748922a-4bf4-4f33-94cf-9ad57ee86689 tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-8f386bd6-aa2b-4de2-a138-c5d72e19129e-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-8f386bd6-aa2b-4de2-a138-c5d72e19129e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-2970f6ad-cabf-4dda-936d-a06894dff8eb" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-2970f6ad-cabf-4dda-936d-a06894dff8eb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-8f386bd6-aa2b-4de2-a138-c5d72e19129e" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-8f386bd6-aa2b-4de2-a138-c5d72e19129e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot 8f386bd6-aa2b-4de2-a138-c5d72e19129e of volume 2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc866abd-6d5f-450a-8cb3-44105722817e]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:33 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e Nov 06 19:55:33 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:33 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e" returned: 0 in 0.376s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2970f6ad-cabf-4dda-936d-a06894dff8eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e232e8-3124-40f4-b767-0383c032483f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:33 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb Nov 06 19:55:33 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:33 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb" returned: 0 in 0.380s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:33 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:34 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e Nov 06 19:55:34 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:34 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e" returned: 0 in 0.362s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:34 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e Nov 06 19:55:34 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:34 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:34 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb.8f386bd6-aa2b-4de2-a138-c5d72e19129e" returned: 0 in 0.267s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-8f386bd6-aa2b-4de2-a138-c5d72e19129e" released by "_delete_snapshot" :: held 1.518s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-2970f6ad-cabf-4dda-936d-a06894dff8eb" released by "delete_snapshot" :: held 1.545s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:34 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Created reservations ['ce065c4f-ac8c-4189-a68c-acd06e047a48', 'c4520d3c-20df-4316-9b83-555ca1bb5ec6', '78f98bf4-629f-4fb5-aad1-f088b6640c6a', '99482b3c-c8a2-4090-949f-0669039643c2'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:34 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:55:34 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-484d617f-49a3-4bea-a100-28aacb77a453 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-8f386bd6-aa2b-4de2-a138-c5d72e19129e-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-2970f6ad-cabf-4dda-936d-a06894dff8eb-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-2970f6ad-cabf-4dda-936d-a06894dff8eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-2970f6ad-cabf-4dda-936d-a06894dff8eb" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-2970f6ad-cabf-4dda-936d-a06894dff8eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[442c014e-7bc3-49ad-ac55-3a775b85f5ab]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:35 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb Nov 06 19:55:35 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:35 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb" returned: 0 in 0.407s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:35 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:35 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb Nov 06 19:55:35 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:36 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-2970f6ad-cabf-4dda-936d-a06894dff8eb" returned: 0 in 0.246s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-2970f6ad-cabf-4dda-936d-a06894dff8eb" released by "delete_volume" :: held 0.724s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Created reservations ['b6825e9c-f7a2-4393-be0e-d2a0d843cba4', 'b740d73c-21e8-491f-a0c4-833da2433110', '7572e55c-ecaa-4819-bede-f55a3e3ccbe3', 'a433e553-5d2a-460e-9159-59ab4ad6848a'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:36 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:36 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:36 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.265s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:36 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-ae61f0b3-ca0e-4d79-b3d7-360f185eb781 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-2970f6ad-cabf-4dda-936d-a06894dff8eb-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (857ce1ac-ab3e-4ba6-80dd-6ab2d5880575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a368803b-b689-4174-804f-4097c9fe46c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a368803b-b689-4174-804f-4097c9fe46c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367913549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6959f6-00be-45ec-9047-523ca674e944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:37Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19676627-fa1b-4b5f-9e35-9da2061c4a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19676627-fa1b-4b5f-9e35-9da2061c4a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db33e78-4a7f-468b-95fd-a3c43e9c9aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db33e78-4a7f-468b-95fd-a3c43e9c9aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6959f6-00be-45ec-9047-523ca674e944', 'volume_name': 'volume-ae6959f6-00be-45ec-9047-523ca674e944', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0cc595-e1ad-496a-a342-b2f6ecc3a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0cc595-e1ad-496a-a342-b2f6ecc3a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1f38e4-653c-4d42-9280-c36af6b6ba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:36 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Volume ae6959f6-00be-45ec-9047-523ca674e944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6959f6-00be-45ec-9047-523ca674e944', 'volume_size': 1} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367913549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6959f6-00be-45ec-9047-523ca674e944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:37Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Creating volume ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:36 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:36 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:37 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 1073741824 Nov 06 19:55:37 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:37 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 1073741824" returned: 0 in 0.477s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:37 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 Nov 06 19:55:37 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:37 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944" returned: 0 in 0.266s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1f38e4-653c-4d42-9280-c36af6b6ba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6959f6-00be-45ec-9047-523ca674e944', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f83310-56ba-4c57-afac-003a33ff90e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:37 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Volume volume-ae6959f6-00be-45ec-9047-523ca674e944 (ae6959f6-00be-45ec-9047-523ca674e944): created successfully Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f83310-56ba-4c57-afac-003a33ff90e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:37 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (857ce1ac-ab3e-4ba6-80dd-6ab2d5880575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:37 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2cd11982-c2e8-420f-8632-b4f11df797ee tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot 39969a50-5553-48cb-91b9-96b923035910 of volume ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f36996-5ec4-4074-a0f0-d38762e0d450]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:39 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 Nov 06 19:55:39 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:39 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944" returned: 0 in 0.360s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:39 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 1G Nov 06 19:55:39 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:39 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 1G" returned: 0 in 0.382s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:39 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6959f6-00be-45ec-9047-523ca674e944 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:39 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6959f6-00be-45ec-9047-523ca674e944 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 Nov 06 19:55:39 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:40 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6959f6-00be-45ec-9047-523ca674e944 -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910" returned: 0 in 0.290s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:40 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 is being set with open permissions: ugo+rw Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:40 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 Nov 06 19:55:40 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:40 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910" returned: 0 in 0.237s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:40 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.info Nov 06 19:55:40 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:40 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.info" returned: 0 in 0.246s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:40 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.info is being set with open permissions: ugo+rw Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:40 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.info Nov 06 19:55:40 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:40 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.info" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:40 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:40 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-e845544f-222e-4858-a018-c72e79355dc7 tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-39969a50-5553-48cb-91b9-96b923035910-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-39969a50-5553-48cb-91b9-96b923035910-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-ae6959f6-00be-45ec-9047-523ca674e944" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-ae6959f6-00be-45ec-9047-523ca674e944" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-39969a50-5553-48cb-91b9-96b923035910" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-39969a50-5553-48cb-91b9-96b923035910" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot 39969a50-5553-48cb-91b9-96b923035910 of volume ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4be519-cc50-4699-9fb8-2aaf5c8ffc6c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:41 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 Nov 06 19:55:41 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:41 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910" returned: 0 in 0.345s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae6959f6-00be-45ec-9047-523ca674e944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[521dceac-26ae-4de1-8ee3-974ac7c5c24f]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:41 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:41 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 Nov 06 19:55:41 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:42 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944" returned: 0 in 0.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:42 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 Nov 06 19:55:42 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:42 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910" returned: 0 in 0.336s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:42 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910 Nov 06 19:55:42 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:42 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944.39969a50-5553-48cb-91b9-96b923035910" returned: 0 in 0.247s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-39969a50-5553-48cb-91b9-96b923035910" released by "_delete_snapshot" :: held 1.371s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-ae6959f6-00be-45ec-9047-523ca674e944" released by "delete_snapshot" :: held 1.392s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Created reservations ['26ab9d73-72eb-4fc6-b3e8-2b8cfa659f30', 'f7995e8e-e1ae-4cd6-8045-3b9a8b8895f8', 'd9319a40-a04a-45ee-bb55-293e847abda4', '33d140d5-0373-42e3-b54a-3cd03b7fcbf7'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:42 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:55:42 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-d1ad3d98-79f4-4b0b-a90f-efed59087675 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-39969a50-5553-48cb-91b9-96b923035910-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-ae6959f6-00be-45ec-9047-523ca674e944-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-ae6959f6-00be-45ec-9047-523ca674e944-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-ae6959f6-00be-45ec-9047-523ca674e944" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-ae6959f6-00be-45ec-9047-523ca674e944" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46e2cb8-cb00-47d4-8bf1-9f90ff6835ce]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:43 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 Nov 06 19:55:43 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:43 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944" returned: 0 in 0.370s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:43 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:43 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944 Nov 06 19:55:43 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:44 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-ae6959f6-00be-45ec-9047-523ca674e944" returned: 0 in 0.233s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-ae6959f6-00be-45ec-9047-523ca674e944" released by "delete_volume" :: held 0.664s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Created reservations ['5a49b114-69d3-40fc-99ef-421aac03b151', 'c63d9b36-1ea7-4666-b8d3-d69541803913', 'c255b9b2-0113-4522-8c31-cc86770493c6', '2e075fb5-f292-4d3e-b279-387270b60142'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:44 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:44 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:44 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.255s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:44 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-771ab5c1-edc6-4e7d-b88e-3e70dd569003 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-ae6959f6-00be-45ec-9047-523ca674e944-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (9b8d6ba5-9c29-4ed3-affe-ece933674536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a673896-d1e2-4021-8506-c73bce7eeee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a673896-d1e2-4021-8506-c73bce7eeee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105997945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29719812-e157-4ad9-be93-0d4a6e614d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:45Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81235ec5-9900-42b1-84b0-c677e4747e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81235ec5-9900-42b1-84b0-c677e4747e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dd8cd7-9f57-44ad-9519-6646fddee254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:44 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dd8cd7-9f57-44ad-9519-6646fddee254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29719812-e157-4ad9-be93-0d4a6e614d7c', 'volume_name': 'volume-29719812-e157-4ad9-be93-0d4a6e614d7c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0670e7-5821-4df1-90bd-8e8463aa7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0670e7-5821-4df1-90bd-8e8463aa7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6a32ee-53ec-4dc8-b759-536cb079c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:45 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Volume 29719812-e157-4ad9-be93-0d4a6e614d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29719812-e157-4ad9-be93-0d4a6e614d7c', 'volume_size': 1} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105997945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29719812-e157-4ad9-be93-0d4a6e614d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:45Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Creating volume 29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:45 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:45 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c 1073741824 Nov 06 19:55:45 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:45 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c 1073741824" returned: 0 in 0.412s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:45 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c Nov 06 19:55:45 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:45 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c" returned: 0 in 0.242s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6a32ee-53ec-4dc8-b759-536cb079c408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29719812-e157-4ad9-be93-0d4a6e614d7c', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60611797-4ecd-470b-9214-1ada046c1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:45 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Volume volume-29719812-e157-4ad9-be93-0d4a6e614d7c (29719812-e157-4ad9-be93-0d4a6e614d7c): created successfully Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60611797-4ecd-470b-9214-1ada046c1df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:45 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (9b8d6ba5-9c29-4ed3-affe-ece933674536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:45 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-511f5634-7813-4d85-ae74-3718f26c0cac tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot f209e8ba-5818-4c4d-9a91-2bc098c265ed of volume 29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c670b3-f5f6-4b82-8bb7-e1b6dc75e382]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:46 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c Nov 06 19:55:46 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:46 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c" returned: 0 in 0.357s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:46 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed 1G Nov 06 19:55:46 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:46 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed 1G" returned: 0 in 0.389s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:46 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29719812-e157-4ad9-be93-0d4a6e614d7c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:46 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29719812-e157-4ad9-be93-0d4a6e614d7c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed Nov 06 19:55:46 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:47 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29719812-e157-4ad9-be93-0d4a6e614d7c -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed" returned: 0 in 0.287s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:47 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed is being set with open permissions: ugo+rw Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:47 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed Nov 06 19:55:47 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:47 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:47 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:47 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:47 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.265s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_service.periodic_task [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] Running periodic task VolumeManager._thread_info {{(pid=86928) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread count: 28 {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7ddc872f-d3b8-4675-8f34-84e18ea7a4cc None None] thread info: [<_MainThread(MainThread, started 140255094870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86928) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 19:55:47 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.info Nov 06 19:55:47 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:47 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.info" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:47 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.info is being set with open permissions: ugo+rw Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:47 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.info Nov 06 19:55:47 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:47 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.info" returned: 0 in 0.245s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:47 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:47 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-213868ce-433f-4024-becf-3f88637d750c tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-f209e8ba-5818-4c4d-9a91-2bc098c265ed-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-f209e8ba-5818-4c4d-9a91-2bc098c265ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-29719812-e157-4ad9-be93-0d4a6e614d7c" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-29719812-e157-4ad9-be93-0d4a6e614d7c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-f209e8ba-5818-4c4d-9a91-2bc098c265ed" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-f209e8ba-5818-4c4d-9a91-2bc098c265ed" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot f209e8ba-5818-4c4d-9a91-2bc098c265ed of volume 29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c792e75-0311-48b6-a2e8-9dd338c50c73]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:48 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed Nov 06 19:55:48 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:48 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed" returned: 0 in 0.351s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29719812-e157-4ad9-be93-0d4a6e614d7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[672041fa-8ccc-4060-812a-fa8812f9f33c]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:48 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:48 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c Nov 06 19:55:48 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:49 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c" returned: 0 in 0.339s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:49 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed Nov 06 19:55:49 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:49 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed" returned: 0 in 0.331s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:49 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed Nov 06 19:55:49 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:49 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c.f209e8ba-5818-4c4d-9a91-2bc098c265ed" returned: 0 in 0.243s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-f209e8ba-5818-4c4d-9a91-2bc098c265ed" released by "_delete_snapshot" :: held 1.354s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-29719812-e157-4ad9-be93-0d4a6e614d7c" released by "delete_snapshot" :: held 1.375s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Created reservations ['bd556079-1afe-428a-bed4-2dd3a4a763f7', 'c0638089-767d-4e4f-8b6d-aefd2caa84b4', '0aa27976-c854-408d-be07-3621e86c3619', '59ddca62-1b1b-4b34-9922-084630363c97'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:49 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:55:49 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-2b161353-f579-4ca1-94b1-906e10dd0282 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-f209e8ba-5818-4c4d-9a91-2bc098c265ed-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-29719812-e157-4ad9-be93-0d4a6e614d7c-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Lock "cinder-29719812-e157-4ad9-be93-0d4a6e614d7c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-29719812-e157-4ad9-be93-0d4a6e614d7c" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-29719812-e157-4ad9-be93-0d4a6e614d7c" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6578a8d-3652-475d-81ac-83d8efd44d77]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:50 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c Nov 06 19:55:50 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:50 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c" returned: 0 in 0.348s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:50 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:50 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c Nov 06 19:55:50 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:51 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-29719812-e157-4ad9-be93-0d4a6e614d7c" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-29719812-e157-4ad9-be93-0d4a6e614d7c" released by "delete_volume" :: held 0.640s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Created reservations ['c034455b-838d-408f-acbf-0bdb8e2d7545', 'e8d7aca2-8648-47dc-adea-9280d5a604f0', 'e83c76d3-913e-49cb-a61b-9568ec6cebb3', '154f3c20-071c-4976-b3ad-5c0c5cc13d9b'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:51 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:51 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:51 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:51 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-dbb816d2-9521-4452-b048-d42f7599f04c tempest-ProjectMemberTests-1241856426 None] Lock "cinder-29719812-e157-4ad9-be93-0d4a6e614d7c-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86928) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (3fe6fcd4-2178-4425-b556-ced037329b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d720ed8-b53e-4e69-953b-61857bc58a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d720ed8-b53e-4e69-953b-61857bc58a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970245017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfef876-f185-4cbf-8513-ac9abbef6bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:52Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aef1261-1dae-495d-bffd-0a315c50d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aef1261-1dae-495d-bffd-0a315c50d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26994453-d53d-4d63-95d2-e290f4c6c75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26994453-d53d-4d63-95d2-e290f4c6c75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bfef876-f185-4cbf-8513-ac9abbef6bbd', 'volume_name': 'volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b43dc2-b431-4105-b42d-0f99c6830d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b43dc2-b431-4105-b42d-0f99c6830d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e25901-5eff-4222-98f0-42e185533411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:51 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Volume 4bfef876-f185-4cbf-8513-ac9abbef6bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd', 'volume_size': 1} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T18:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970245017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfef876-f185-4cbf-8513-ac9abbef6bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aa16488359d4e99b8e3f6384a8a5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T18:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T18:55:52Z,use_quota=True,user_id='fa011494052642f6b6f79a5e62f09e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132dba01-f70d-45d6-a0c2-80616f08ada5),volume_type_id=132dba01-f70d-45d6-a0c2-80616f08ada5)}" {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Creating volume 4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:51 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 as target Quobyte volume. {{(pid=86928) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 19:55:52 devstack cinder-volume[86928]: INFO cinder.volume.drivers.remotefs [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6 Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd 1073741824 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:52 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd 1073741824 Nov 06 19:55:52 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:52 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd 1073741824" returned: 0 in 0.392s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:52 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd Nov 06 19:55:52 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:52 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd" returned: 0 in 0.236s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'} {{(pid=86928) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e25901-5eff-4222-98f0-42e185533411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd', 'volume_size': 1}' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c35da0-5693-42de-961d-9dc426442743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 19:55:52 devstack cinder-volume[86928]: INFO cinder.volume.flows.manager.create_volume [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Volume volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd (4bfef876-f185-4cbf-8513-ac9abbef6bbd): created successfully Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c35da0-5693-42de-961d-9dc426442743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86928) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 19:55:52 devstack cinder-volume[86928]: DEBUG cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Flow 'volume_create_manager' (3fe6fcd4-2178-4425-b556-ced037329b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86928) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 19:55:52 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-7d6a4054-ac51-4e1f-90a8-2fcaaa6459a5 tempest-ProjectMemberTests-1241856426 None] Created volume successfully. Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Creating offline snapshot 617dc180-60ae-4b25-9088-ca7d0c1b58f4 of volume 4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f4e48d-2736-4653-a824-d8834012a819]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:53 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd Nov 06 19:55:53 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:53 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd" returned: 0 in 0.347s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 1G {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:53 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 1G Nov 06 19:55:53 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:53 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 1G" returned: 0 in 0.370s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:53 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:53 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 Nov 06 19:55:53 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:54 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd -F qcow2 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4" returned: 0 in 0.285s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:54 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 is being set with open permissions: ugo+rw Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:54 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 Nov 06 19:55:54 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:54 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4" returned: 0 in 0.242s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:54 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.info Nov 06 19:55:54 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:54 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.info" returned: 0 in 0.248s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:54 devstack cinder-volume[86928]: WARNING cinder.volume.drivers.remotefs [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.info is being set with open permissions: ugo+rw Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.info {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:54 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.info Nov 06 19:55:54 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:54 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.info" returned: 0 in 0.234s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:54 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:54 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-43c518df-49c9-4334-9a84-e3fade9e27fe tempest-ProjectMemberTests-1241856426 None] Create snapshot completed successfully Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-617dc180-60ae-4b25-9088-ca7d0c1b58f4-delete_snapshot" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-617dc180-60ae-4b25-9088-ca7d0c1b58f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-4bfef876-f185-4cbf-8513-ac9abbef6bbd" by "delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-4bfef876-f185-4cbf-8513-ac9abbef6bbd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-617dc180-60ae-4b25-9088-ca7d0c1b58f4" by "_delete_snapshot" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-617dc180-60ae-4b25-9088-ca7d0c1b58f4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Deleting offline snapshot 617dc180-60ae-4b25-9088-ca7d0c1b58f4 of volume 4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] snapshot_file for this snap is: volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 {{(pid=86928) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1acff-a299-445b-8290-052f299612ed]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:55 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 Nov 06 19:55:55 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:55 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4" returned: 0 in 0.353s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.remotefs [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86928) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fb693-c98a-46ac-8af2-b5fe0e3757eb]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:55 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:55 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd Nov 06 19:55:55 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:56 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd" returned: 0 in 0.348s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:56 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 Nov 06 19:55:56 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:56 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4" returned: 0 in 0.326s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:56 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4 Nov 06 19:55:56 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:56 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd.617dc180-60ae-4b25-9088-ca7d0c1b58f4" returned: 0 in 0.242s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-617dc180-60ae-4b25-9088-ca7d0c1b58f4" released by "_delete_snapshot" :: held 1.357s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-4bfef876-f185-4cbf-8513-ac9abbef6bbd" released by "delete_snapshot" :: held 1.379s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Created reservations ['0d94058e-a476-434f-9218-6e5c6313977f', '00dadbec-5f8d-4e2c-be0f-9e926e5991ae', 'f9e2f7f6-82b1-4005-847f-7ae890147daa', '121b514b-b4f5-41c3-832f-5e1eaaf99507'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:56 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Delete snapshot completed successfully. Nov 06 19:55:56 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-bedd466a-0adc-423c-85bc-813dd075a297 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-617dc180-60ae-4b25-9088-ca7d0c1b58f4-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-4bfef876-f185-4cbf-8513-ac9abbef6bbd-delete_volume" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-4bfef876-f185-4cbf-8513-ac9abbef6bbd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "cinder-quobyte-4bfef876-f185-4cbf-8513-ac9abbef6bbd" by "delete_volume" {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-4bfef876-f185-4cbf-8513-ac9abbef6bbd" acquired by "delete_volume" :: waited 0.015s {{(pid=86928) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb1e18c-4162-4756-be5a-f39cf9d8c920]: (4, 'qcow2') {{(pid=88585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:57 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd Nov 06 19:55:57 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:57 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd" returned: 0 in 0.364s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:57 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:57 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd Nov 06 19:55:57 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:58 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6/volume-4bfef876-f185-4cbf-8513-ac9abbef6bbd" returned: 0 in 0.250s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-quobyte-4bfef876-f185-4cbf-8513-ac9abbef6bbd" released by "delete_volume" :: held 0.673s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG cinder.quota [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Created reservations ['41fad4df-944e-4b77-85c0-ee495e04c923', '7cd7451d-427e-41fc-ad89-0146b23f8a2d', '7ae01924-7312-499a-abc1-3268c1e10bc6', '2a3b56f0-1578-4e8e-94e4-47ae7daf6fe9'] {{(pid=86928) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6': None} {{(pid=86928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG cinder.volume.drivers.quobyte [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef3cf1e4-53e9-4437-85c6-563809fb91c6'] {{(pid=86928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.lockutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 19:55:58 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6 Nov 06 19:55:58 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 19:55:58 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG oslo_concurrency.processutils [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de28fa7d7acf27103716c427235455b6" returned: 0 in 0.237s {{(pid=86928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG cinder.manager [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Notifying Schedulers of capabilities ... {{(pid=86928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 19:55:58 devstack cinder-volume[86928]: INFO cinder.volume.manager [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Deleted volume successfully. Nov 06 19:55:58 devstack cinder-volume[86928]: DEBUG cinder.coordination [None req-30355562-864b-4fb1-99c2-181216828e68 tempest-ProjectMemberTests-1241856426 None] Lock "cinder-4bfef876-f185-4cbf-8513-ac9abbef6bbd-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86928) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 19:56:08 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:SELECT=64,cinder:INSERT=28,cinder:UPDATE=87,cinder:DELETE=4 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 19:56:08 devstack cinder-volume[86928]: DEBUG dbcounter [-] [86928] Writing DB stats cinder:UPDATE=84,cinder:SELECT=66,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}